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Abstract 


In  1996,  the  Commandant  of  the  U.S.  Coast  Guard  initiated  the  largest  ever  service 
acquisition  program  to  re-capitalize  Coast  Guard  assets.  Called  the  Integrated  Deepwater 
System  or  IDS,  this  acquisition  effort  seeks  to  renovate,  modernize,  and  or  replace  the 
Coast  Guard’s  entire  portfolio  of  ships,  aircraft,  and  support  facilities.  The  IDS  contractor 
will  be  responsible  for  designing  and  constructing  the  system,  as  well  as,  sharing 
responsibility  for  supporting  and  disposing  of  it.  This  poses  a  significant  threat  to  the 
USCG  Aircraft  Repair  and  Supply  Center  (AR&SC),  the  Coast  Guard’s  aircraft  depot 
located  in  Elizabeth  City,  North  Carolina.  Is  AR&SC  prepared  to  compete  for  this  IDS 
workload? 

The  study  begins  with  the  development  of  a  Research  model  of  public  entity 
competitiveness.  The  resulting  model  is  based  on  three  generic  key  factors:  Politics,  Cost, 
and  Organic;  it  also  identifies  multiple  generic  sub  factors.  The  model  is  verified  using 
the  Delphi  Technique  to  obtain  consensus  among  experts  in  the  field  of  public  private 
competition  and  source  selections.  After  data  collection,  the  results  are  integrated  into  an 
evaluation  tool  called  the  Public  Private  Competition  Assessment  Tool  (PC AT). 

Although  generic,  the  PCAT  is  customized  to  provide  AR&SC  management  with  a 
strategic  baseline  for  competitive  preparations. 
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AN  EMPIRICAL  INVESTIGATION  OF  CRITICAL  FACTORS  AFFECTING  THE  ABILITY 


OF  PUBLIC  ENTITIES  TO  COMPETE  IN  PUBLIC  PRIVATE  COMPETITIONS 


I.  Introduction 


Background 

In  1996,  the  Commandant  of  the  U.S.  Coast  Guard  initiated  the  largest  ever  service 
acquisition  program  to  re-capitalize  U.  S.  Coast  Guard  assets.  As  of  today,  seven  of  the  Coast 
Guard's  nine  classes  of  deepwater  assets  reach  the  end  of  their  planned  service  life  in  the  next 
fifteen  years.  The  term  deepwater  is  synonymous  with  assets  able  to  conduct  sustained  Coast 
Guard  operations  50  nautical  miles  or  more  off  shore.  Called  the  Integrated  Deepwater  System 
or  IDS,  this  acquisition  effort  seeks  to  renovate,  modernize,  and  or  replace  the  Coast  Guard’s 
entire  portfolio  of  deepwater  ships  and  aircraft  with  an  integrated  system  of  surface,  air,  C4ISR 
(Command,  Control,  Communications,  Computers,  Intelligence,  Surveillance,  and 
Reconnaissance),  and  logistics  capabilities.  Based  on  the  Department  of  Defense  Life  Cycle 
Acquisition  Model,  the  IDS  is  unique  because  it  implements  an  innovative  mission-based 
performance  acquisition  approach. 

Rather  than  focus  on  any  one  ship  or  aircraft  program,  the  Coast  Guard  strategy  concentrates 
on  meeting  all  of  its  nationally  mandated  missions  to  include  Marine  Environmental  Protection, 
Maritime  Law  Enforcement,  National  Defense,  and  Maritime  Safety.  The  IDS  program  will 
partner  with  a  world  class  Systems  Integration  and  Management  Contractor  to  design,  construct, 
deploy,  operate,  support  and  dispose  of  this  system  of  systems.  The  Coast  Guard  will  be 
responsible  for  managing  operational  requirements,  responding  to  mission  demands  and 
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environment  changes,  and  operating  the  system;  the  IDS  Contractor  will  be  responsible  for 
designing  and  constructing  the  system,  as  well  as,  sharing  responsibility  for  supporting  and 
disposing  of  it. 

One  of  the  major  positions  of  the  IDS  philosophy  is  to  take  advantage  of  industries  ability  to 
perform  logistical  and  support  tasks  traditionally  operated  by  Coast  Guard  personnel  in  order  to 
lower  ownership  costs.  According  to  the  Deepwater  Request  for  Proposal  (RFP),  the  IDS 
Contractor  shall  “implement  a  Total  Ownership  Cost  (TOC)  program  to  ensure  that  cost  of 
ownership  is  considered  throughout  IDS  and  IDS  asset  concept  technology  development,  system 
development  and  demonstration,  production  and  deployment,  operation  &  support  and  disposal, 
including  legacy  assets.”  (Deepwater,  2001)  Additionally,  the  IDS  shall  be  designed  with 
consideration  of  shore  support  activities  to  include  facility  additions,  modifications,  expansions, 
contractions,  and,  finally,  closures.  The  RFP  further  requires  the  contractor  to  provide  a  matrix 
which  lists  the  contractors  ability  to  meet  the  requirements  for  system  asset  level  logistics 
development,  design,  production,  implementation,  and  disposal  by  Integrated  Logistics  System 
(ILS)  asset  element.  Each  potential  contractor  will  be  provided  with  an  open  template  to  develop 
and  maintain  an  ILS  asset  specific  reflecting  operational  deployment  of  that  IDS 
asset.(Deepwater  2001)  Of  key  interest  here  is  any  proposal  submitted  to  conduct  depot-level 
aircraft  maintenance  in  support  of  this  IDS  philosophy  of  maintaining  low  ownership  costs. 

This  particular  issue  demands  the  attention  of  the  present  U.S.  Coast  Guard  support 
infrastructure,  in  particular  to  this  study,  the  Aviation  Repair  and  Supply  Center  (AR&SC) 
located  in  Elizabeth  City  North  Carolina.  Built  on  the  banks  of  the  Pasquotank  River,  AR&SC 
provides  complete  integrated  logistics  support  to  the  aviation  community  of  the  Coast  Guard.  It 
is  an  industrial  center  whose  mission  is  to  provide  the  fleet  with  technical  engineering  support, 
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supply  stocking  requirements,  aircraft  overhaul,  parts  reengineering  and  manufacturing,  and  on¬ 
site  repair  teams.  It  manages  a  budget  of  $  160  Million  annually  with  a  $743  Million  inventory  of 
aircraft  parts.  The  labor  force  consists  of  644  members  of  which  495  are  skilled  civilian  workers 
and  149  are  military  maintenance  specialists.  On  an  average  day,  the  depot  ships  620  parts, 
answers  hundreds  of  field  technical  questions,  works  20  aircraft  in  varies  stages  of  overhaul,  and 
an  additional  three  aircraft  for  “drop  in”  maintenance.  Additionally,  it  manages  150  contracts, 
and  has  2  maintenance  teams  visiting  field  Coast  Guard  Air  Stations.(AR&SC  2000)  AR&SC  is 
also  a  major  reengineering  and  overhaul  facility  for  hundreds  of  U.S.  Navy  and  U.S.  Air  Force 
Sikorsky  helicopter  components.  Further  solidifying  its  position  as  a  war  fighting  industrial 
base,  the  depot  began  full  aircraft  overhauls  of  the  U.S.  Air  Force  Sikorsky  MH-60G  Pave  hawk 
fleet  in  the  summer  of  200 1 .  (Jewess,  2001) 

In  the  1990s,  managers  of  AR&SC  identified  three  potential  threats  to  depot  operations  in  the 
form  of  Federal  budget  cuts,  workforce  downsizing,  and,  increasing  bureaucratic  regulations 
such  as  Flazardous  Material  (HAZMAT)  Laws.  After  considerable  evaluation  and  planning,  a 
complete  redesign  of  product  lines  and  work  processes  took  place  enabling  the  depot  to  deliver 
its  services  more  efficiently  and  effectively  to  the  customer.  Basing  the  reorganization  on  cross¬ 
functionality  to  streamline  processes,  these  initiatives  have  resulted  in  substantial  cost  savings, 
work/life  labor  improvements,  an  increased  customer  base,  improved  customer  satisfaction, 
increased  product  and  service  quality,  and  improved  union-management  relations.(AR&SC, 

2000)  However,  with  the  advent  of  the  IDS  program,  another  threat  has  emerged  in  the  form  of 
potential  depot  outsourcing.  As  a  defensive  strategy  to  this  IDS  philosophy  of  reducing 
ownership  costs,  AR&SC  must  ensure  that  its  streamlined,  cost  effective  public  organization  is 
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prepared  to  participate  as  a  highly  competitive  team  in  any  potential  public-private  competition 
for  aircraft  depot  workloads. 

Public  Private  Competitions 

It  is  important  to  clearly  understand  the  term  Public  Private  Competition.  This  form  of 
competition  breaks  the  common  pattern  of  a  service  delivery  in  which  the  service  is  provided 
exclusively  by  public  employees  or  exclusively  by  private  sectors  across  an  entire  workload. 
(Ammons  and  Hill,  1995)  Government  procurement  and  quasi-procurement  type  situations,  in 
which  the  public  sector  competes  with  the  private  sector  to  provide  government  services,  can  be 
considered  a  standard  form  of  any  Public-Private  Competition  definition. (Martin,  1999)  Public- 
Private  Competition  has  also  been  called  a  Managed  Competition ;  the  term  is  used  to  describe 
two  parties,  private  and  public,  competing  head-to  head  for  lucrative  contracts  with  the 
government  entity  refereeing  the  competitive  playing  field. (Barber,  1998)  This  competition 
involves  the  bidding  process  as  private  contractors  vie  with  government  agencies  for  the 
privilege  of  delivering  a  service. (Ammons  and  Hill  1995)  Three  forms  of  Public  Private 
Competitions  have  been  identified:  the  Ad-Hoc  Approach,  the  Informal  Bidding,  and  the  Formal 
Bidding.  The  Ad-Hoc  approach  is  when  a  public  sector  service  is  simply  compared  to  private 
sector  services.  Informal  Bidding  is  initiated  when  the  public  sector  submits  informal  bids  or 
proposals  that  are  compared  to  formal  bids  submitted  by  the  private  sector.  Finally,  the  Formal 
Bidding  process  is  considered  when  the  public  sector  submits  formal  proposals  that  are  then 
compared  with  formal  proposals  submitted  by  the  private  sector.  (Martin,  1 999)  The  Informal 
and  Formal  Bidding  will  be  considered  as  two  prime  definitions  for  purposes  of  this  thesis  effort. 
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Research  Question 

This  first  half  of  this  study  identified  the  generic  and  underlying  factors  which  provide  the 
foundation  for  a  competitive  public  proposal.  It  was  conducted  utilizing  the  Delphi  Technique,  a 
method  used  for  the  elicitation  of  opinions  with  the  object  of  obtaining  a  group  consensus  of  a 
panel  of  experts,  to  build  a  list  of  these  competitive  building  blocks.  (Brown,  1969)  The  experts 
used  in  this  technique  formed  a  group  of  professionals  representing  academia,  military 
contracting  commands,  and  private  sector  communities.  Historically,  it  has  been  a  challenge  for 
public  organizations  to  prepare  competitive  proposals  that  compete  at  a  level  associated  with 
lucrative  and  experienced  private  sector  firms.(GAO,  1996)  This  research  focused  on  the 
necessary  subject  areas  that  must  be  addressed  by  any  public  organization  to  develop  a  highly 
competitive  proposal.  The  first  research  question  can,  therefore,  be  stated  as  the  following: 

What  factors  must  a  Public  Entity  allocate  resources  in  order  to  prepare  a  competitive 

proposal  for  a  Public  Private  Competition? 

The  second  half  of  this  study  examined  the  present  state  of  AR&SC  to  obtain  a  factor 
baseline.  Te  depot’s  present  business  practices  were  examined  to  see  at  what  level,  if  any,  those 
key  factors  are  being  addressed.  This  baseline  was  captured  through  the  use  of  an  assessment 
tool  developed  from  the  results  of  the  Delphi  process.  The  assessment  tool  was  provided  to  U.S. 
Coast  Guard  management  personnel  located  at  AR&SC.  From  this  baseline,  it  is  hoped  that  a 
tool  might  be  developed  which  could  provide  depot  management  a  strategic  direction  for 
allocating  limited  resources  for  proposal  development.  The  second  research  question  can, 
therefore,  be  stated  as  the  following: 

What  is  the  Aircraft  Repair  and  Supply  Center’s  overall  position  in  addressing  these  key 
factors  to  create  a  competitive  public  proposal  for  a  managed  competition? 
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Potential  Benefits 


The  identification  of  these  key  factors  will  hopefully  provide  AR&SC,  and  other  Coast  Guard 
public  entities,  with  the  roots  for  a  valuable  defense  against  outsourcing.  As  with  past  managed 
competitions  before  it,  it  can  be  assumed  an  additional  benefit  of  proposal  preparation  will  be  the 
further  streamlining  of  depot  processes  ensuring  an  even  greater,  more  cost  effective  Coast 
Guard  facility.  (GAO,  1996)  Additionally,  it  is  hoped  the  results  of  this  study  can  be  applied  to 
other  Coast  Guard  support  entities  further  increasing  their  efficiencies  in  direct  support  of  the 
Coast  Guard  IDS  philosophy  of  minimizing  ownership  costs. 

Thesis  Overview 

The  next  chapter  will  present  the  literary  research  and  development  of  a  key  factor  research 
model.  Chapter  Three  will  discuss  how  the  research  was  conducted  and  explain  the  Delphi 
method  of  group  consensus  to  validate  the  model.  It  will  also  present  the  design  and 
implementation  of  an  assessment  tool  to  evaluate  AR&SC  in  reference  to  the  identified  key 
factors  of  the  research  model.  Chapter  Four  will  assess  the  data  obtained  from  the  Delphi 
method  along  with  the  results  of  the  AR&SC  assessment.  Finally,  Chapter  Five  will  contain 
final  conclusions  of  the  study  and  provide  suggestions  on  follow-up  research. 
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II.  Literature  Review 


Background  on  Public  Private  Competitions 

As  discussed  in  Chapter  one,  Public  Private  Competition  is  synonymous  with  the  term 
Managed  Competition.  Managed  competition  is  essentially  the  competition  of  a  public  and 
private  entity  for  a  service  previously  provided  by  a  public  entity.  William  D.  Eggers,  the 
director  of  privatization  and  government  reform  at  the  Reason  Public  Policy  Institute,  states  that 
when  governments  decide  to  test  the  market  for  providing  services,  in-house  units  are  also  given 
the  opportunity  to  bid  for  providing  the  service.  Additionally  he  states  that  managed  competition 
is  predicated  on  the  notion  that  allowing  the  widest  possible  range  of  competition  between 
different  types  of  providers  is  the  best  way  of  ensuring  high-quality  services  at  the  lowest  price 
with  guaranteed  performance.  (Eggers,  1998) 

Yet  another  definition  of  managed  competition  is  the  following  by  Dr.  Lawrence  L.  Martin 
of  Columbia  University.  In  it  he  defines  managed  competitions  as  situations  in  which  federal 
departments  are  permitted  and  encouraged  to  compete  with  private  sector  firms  and 
organizations  to  provide  government  products  and  services.  Dr.  Martin  further  defines  managed 
competition  as  entailing  procurement  and  quasi-procurement  type  situations  in  which  public 
employees  compete  against  private  sector  firms  and  organizations  to  provide  government 
services.  He  goes  on  to  state  that  the  major  distinction  that  sets  public  private  competition  apart 
from  privatization  is  that  no  a  priori  assumptions  are  made  about  which  sector,  the  pubic  or 
private,  should  provide  government  services.  (Martin,  1999) 

Perhaps  the  simplest  and  clearest  definition  of  managed  competition  is  from  the  originator  of 
the  process  itself,  the  city  of  Phoenix,  Arizona.  In  1979,  the  Phoenix  government  designed  and 
conducted  its  public  private  competition  program  based  on  this  definition:  a  managed 
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competition  is  a  process  that  pursues  productivity  in  government-delivered  services  by  involving 
city  departments  in  competition  with  private  contractors  in  public-bid  situations  to  determine 
who  can  best  provide  services  to  customers.(Flannagan  and  Perkins,  1995) 

A  final  vision  of  public  private  competition  can  be  taken  from  Vice  President  Albert  Gore’s 
National  Performance  Review  from  1993.  In  it,  he  acknowledges  the  present  government  view 
of  managed  competition  as  the  being  one  force  which  gives  public  agencies  no  choice  but  to 
improve.  In  the  article,  he  recommends  that  many  federal  organizations  should  begin  to  compete 
with  private  companies.  (Martin,  1998)  This  definition  reflects  the  service  delivery  thinking  of 
managed  competition  to  obtain  best  value.  An  example  of  this  service  thinking  can  be  seen  in 
the  San  Antonio  and  Sacramento  aircraft  depot  competitions  conducted  by  the  United  States  Air 
Force.  Both  depots  were  put  up  for  competition  to  obtain  better,  more  efficient  and  cost  effective 
overhauls  of  Air  Force  aircraft.  The  San  Antonio  public  private  competition  will  be  discussed 
later  in  this  section. 

For  purposes  of  the  study,  Managed  Competition  is  defined  as  a  process  in  which  public 
entities  are  encouraged  to  compete  with  private  entities  for  the  opportunity  to  provide  an 
overarching  agency  with  products  or  services.  The  term  entity  in  this  definition  is  synonymous 
with  organization. 

The  federal  government  has  not  been  the  first  institution  to  utilize  the  concept  of  managed 
competitions.  In  the  mid  1970s,  the  city  of  Phoenix  was  experiencing  a  population  growth  rate 
much  higher  than  the  average  at  the  time.  During  this  period,  the  state  was  suffering  from  high 
inflation  rates,  and  the  Arizona  legislature  was  passing  revenue  and  expenditure  limitation  laws. 

It  was  becoming  extremely  expensive  for  Phoenix  to  conduct  all  the  city  responsibilities  such  as 
ambulance  services,  billing  services,  data  entry,  and  landfill  operations.  Armed  with  this 
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knowledge,  private  firms  approached  Phoenix  with  proposals  advertising  cost  savings.  Rather 
than  make  a  decision  to  privatize  these  services,  city  officials  chose  to  compare  the  private  sector 
proposals  against  the  cost  of  public  service.  The  result  was  a  selection  process  that  would  award 
contracts  based  on  best  value  to  the  city  council.  Between  1979  and  1994,  the  city  of  Phoenix 
competed  13  service  areas  utilizing  56  competitive  evaluations.  Of  these  56  competitions  held, 
22  were  awarded  to  the  pubic  sector.  (Flannagan  and  Perkins,  1995) 

From  this  experience,  the  city  was  able  to  deduce  some  benefits  associated  with  the  tool  of 
managed  competition.  The  greatest  of  these  benefits  was  that  the  competitive  process  had  the 
ability  to  positively  influence  expectations  about  government  and  gain  public  support  for  its 
endeavors.  The  prevalent  image  of  government  as  an  over  bloated  bureaucracy  slowly  changed 
into  one  where  the  organization  was  constantly  pursuing  a  full  range  of  service  product  areas. 
Process  efficiency  and  customer  focus  became  established,  important  values  allowing  public 
departments  to  improve  themselves  for  the  sake  of  conducting  competitive  proposals.(Flannagan 
and  Perkins,  1995) 

Another  benefit  the  city  of  Phoenix  discovered  was  the  self-directed  attention  to  cost  and 
customer  satisfaction  that  occurs  throughout  the  public  organization.  New  and  fresh  approaches 
to  equipment  designs,  staffing,  and  cross  training  were  explored  by  the  public  department  in  its 
pursuit  to  prepare  a  competitive  proposal.  In  Phoenix’s  refuse  competitions,  for  example,  the 
city  justifiably  purchased  a  new  garbage  truck  when  the  public  refuse  department  was  selected 
the  winner  in  a  managed  competition.  Additionally,  cost  reduction  becomes  a  major  outcome  of 
this  entire  competitive  process.  In  the  city’s  case,  the  public  departments  streamlined  costs  while 
simultaneously  reengineering  processes;  it  is  not  unusual  to  find  this  in  federal  departments  as 
well. 
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Phoenix  also  found  that  its  use  of  managed  competition  forced  development  of  a  management 
information  system.  Traditional  government  accounting  and  information  methods  concentrate 
on  the  needs  of  traditional  accounting  that  focuses  on  reporting  assets  by  standard  line  items.  It 
does  not  focus  on  outcomes,  customers,  and  efficiencies  that  make  up  the  backbone  of  a 
competitive  strategy.  In  the  competitive  environment,  the  public  departments  require  detailed 
cost  information  to  make  decisions  on  process  changes,  improvement  programs,  and  cost 
reduction  initiatives.  Without  accurate  information  on  where  the  high  cost  areas  are 
concentrated,  any  effort  to  positively  effect  the  department  is  done  so  in  the  blind.  In  addition, 
the  city  found  that  an  instantaneous  reporting  system  is  necessary  to  ensure  these  costs  are  sent  to 
all  managers  crucial  to  a  competitive  public  department. (Flannagan  and  Perkins,  1995) 

How  did  the  federal  government  evolve  into  using  managed  competition  as  a  tool  to  lower 
business  costs?  The  Office  of  Management  and  Budget’s  A-76  Circular  can  be  referenced  for 
details.  A  look  back  into  the  history  of  the  A-76  Circular  describes  the  development  of  the 
government’s  present  definition  of  public  private  competition.  In  1955,  the  BOB  Bulletin  55-4, 
the  forerunner  of  the  A-76  circular,  stated  that  the  Federal  Government  will  not  start  or  cany  on 
any  commercial  activity  to  provide  services  or  products  for  its  own  use  if  such  product  or  service 
can  be  procured  from  private  enterprise  through  ordinary  business  channels.  Although  this 
bulletin  did  not  particularly  address  the  issue  of  managed  competition,  it  did  introduce 
government  agencies  to  a  concept  called  privatization.  Privatization  is  defined  as  turning  over 
services  completely  or  partially  to  the  private  sector.(Greenough  and  Eggum,  1999)  The 
important  point  here  is  that  the  notion  of  federal  departments  competing  for  a  contract  was 
addressed,  although  clearly  rejected  in  favor  of  complete  privatization  of  the  service  delivery. 
(Martin,  1998) 
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In  1967,  the  new  Office  of  Management  and  Budget  (OMB)  issued  Circular  A-76  describing 
the  federal  government’s  basic  policy  on  the  provision  of  commercial  type  activities  including 
privatization  of  public  services.  Building  on  the  BOB  Bulletin  55-4,  it  required  federal 
departments  to  transfer  to  the  private  sector  those  commercial  activities  that  could  be  performed 
a  at  a  lower  cost.  (Martin,  1998)  This  document  was  important  because  it  required  a  cost 
comparison  between  the  subject  public  agency  and  the  private  organization  to  create  cost 
baselines.  Although  still  advocating  privatization  as  the  objective,  the  government,  again, 
addressed  a  potential  step  towards  competition  between  the  in  house  entities  and  private  industry. 

During  the  Reagan  administration,  the  OMB  issued  a  supplement  to  the  A-76  circular  that 
provided  further  guidance  on  conducting  a  comparison  of  public  and  private  costs.  The 
methodology  was  based  on  three  principles.  The  first  principle  used  the  concept  of  the  most 
efficient  organization.  This  principle  encouraged  the  public  agencies  to  reengineer  their 
processes  with  the  goal  of  becoming  more  efficient  and  cost  effective.  This  streamlined  agency 
would  then  be  compared  to  the  private  entity  utilizing  the  second  principle  of  make-  or-buy 
comparison. 

This  second  principle  established  a  standard  procedure  for  cost  accounting  in  the  public 
agency.  The  cost  of  the  public  department  was  to  be  computed  utilizing  avoidable  costs.  In  the 
avoidable  cost  comparison,  the  aggregate  cost  of  the  public  department  is  determined  by  adding 
the  total  indirect  and  direct  costs  associated  with  the  entity.  Then,  the  costs  that  are  fixed  or 
unavoidable  (overhead  and  maintenance  costs),  and  will  not  vary  depending  upon  whether  the 
public  or  private  activity  conducts  the  activity,  are  subtracted  from  the  aggregate  cost.  (Martin, 
1998)  This  difference  is  the  avoidable  costs  and  would  represent  the  public  department  total 
expenditure.  It  is  this  cost  which  is  compared  against  the  private  sector  submitted  bid. 
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The  third  and  final  principle  defined  what  constituted  the  bounds  of  transferring  public  sector 
work  to  the  private  sector.  The  circular  stated  that  a  change  from  public  to  private  service 
delivery  would  require  a  cost  savings  of  greater  than  ten  percent  of  the  public  sector’s  personnel- 
related  costs.  In  these  three  principles  can  be  found  the  building  blocks  of  the  present  day 
managed  competition.  These  principles  enabled  further  government  migration  toward  managed 
competition.  Although  the  procedures  demonstrated  a  public-private  competition  perspective, 
the  official  A-76  policy  still  advocated  the  concept  of  privatization  as  the  objective.(Martin, 

1998) 

In  March  of  1996,  yet  another  supplement  to  the  A-76  circular  was  issued.  In  it,  the  circular 
clearly  states  that  government  A-76  procedures  are  not  designed  to  simply  contract  out,  rather, 
they  are  designed  to  complete  three  objectives.  First,  the  circular  was  to  balance  the  interests  of 
parties  to  make-or-buy  cost  comparisons.  Second,  it  was  to  provide  a  level  playing  field  between 
public  and  private  offerors  in  a  competition,  and  third,  it  was  to  encourage  competition  and 
choice  in  the  management  and  performance  of  commercial  activities. (Martin,  1998)  It  has  been 
said  that  the  result  of  this  A-76  revision  was  the  greatest  single  move  of  government  policy 
towards  public  private  competition.  This  was  not,  however,  a  complete  transformation  of  federal 
business  practices.  The  circular  deleted  the  Reagan  era’s  requirement  to  utilize  avoidable  costs, 
and  replaced  it  with  a  requirement  to  use  Total  Costs  for  the  public  entity.  The  result  was  a  net 
increase  in  the  estimated  public  costs  nullifying  any  chance  of  a  neutral  competition  without 
close  evaluation  and  adjustments  by  a  selection  team.(Martin,  1998) 

The  notion  of  public  private  entities  competing  for  service  continues  to  be  one  of  the  most 
popular  cost  saving  initiatives  in  the  federal  govemment.(Martin,  1998)  The  most  recent 
revision  of  A-76,  released  in  1999,  applauds  the  managed  competition  process  as  a  primary 
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means  to  ensure  government  achieves  enhanced  quality,  economy  and  productivity  which  are  all 
goals  of  the  A-76  program.  In  the  Department  of  Defense  (DOD),  managed  competition  has 
been  placed  with  increased  faith  as  a  tool  to  save  money  and  make  its  operation  more  efficient 
and  effective.  Driven  by  recent  successes  in  depot  and  other  competitions,  the  Pentagon  has 
projected  additional  large-scale  savings  for  the  future.  By  the  year  2005,  it  expects  to  save  $9 
billion  by  putting  tasks  involving  200,000  positions  out  for  competitive  bid.  (Gates  and  Robbert, 
2000) 

The  United  States  Air  Force  has  had  recent  success  utilizing  public  private  competitions.  In 
response  to  the  results  of  the  1995  Base  Realignment  And  Closure  (BRAC)  Commission,  a 
decision  was  made  by  the  Air  Force  to  complete  the  realignment  of  Kelly  Air  Force  Base, 
maintenance  depot  of  the  gigantic  C-5  Galaxy  cargo  aircraft.  Worth  $1.1  Billion,  this 
competition  promised  to  be  a  significant  leap  towards  advantages  offered  by  the  A-76  ideals.  In 
1997,  the  government  obtained  four  proposals.  Three  of  the  proposals,  McDonnell  Douglas, 
AeroCorp  S.A.,  and  Lockheed,  were  strictly  civilian,  private  offerors.  The  fourth  was  a  public 
proposal  from  Warner  Robbins  Air  Logistics  Center  (ALC),  an  Air  Force  owned  aircraft  depot. 

It  was  this  fourth,  public  proposal  that  was  eventually  selected  by  the  Source  Selection 
Evaluation  Board  (SSEB)  as  the  best  value  to  the  federal  government.  Although  the  public 
sector  won  this  competition,  it  is  necessary  to  understand  some  of  the  factors  that  allowed  this 
public  success  to  take  place. 

Warner  Robbins  ALC  was  able  to  develop  a  highly  competitive  proposal  comparable  to  what 
was  presented  by  the  other  three  private  offerors.  The  final  proposal  submitted  to  the  Air  Force 
contained  the  following  standout  ideals:  costs  were  captured  in  a  credible  manner  to  submit  a 
competitive  proposal,  strengths  of  the  present  aircraft  depot  operations  were  optimized,  and 
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finally,  any  weaknesses  were  minimized  by  addressing,  head-on,  any  potential  problems.  This 
case  study  will  be  explored  later  as  a  resource  for  the  Research  Factor  Model  development.  But, 
what  can  be  said  of  the  United  States  Coast  Guard  in  regards  to  this  best  value  practice  of 
Managed  Competition? 

Rear  Admiral  Ronald  Silva,  the  Coast  Guard’s  Assistant  Commandant  for  Systems, 
described  the  Coast  Guard’s  infrastructure  as  doing  the  king’s  work  with  a  peasant’s  toolbox. 
Since  1995,  maintenance  funding  has  decreased  by  12%  in  constant  dollars  and  readiness  has 
dropped  by  20%.  Intervals  between  Programmed  Depot  Maintenance  (PDM)  for  aircraft  have 
increased  to  the  maximum  safely  allowable  resulting  in  higher  depot  costs.  These  higher  costs 
are  directly  related  to  the  greater  maintenance  requirements  driven  by  higher  aircraft  cycles. 
These  are  just  a  few  of  the  examples  that  have  haunted  Coast  Guard  managers  in  the  recent 
decade.  Because  of  budget  cuts,  such  as  the  $400  Million  dollars  cut  between  1995  and  1999,  it 
has  been  said  that  the  Coast  Guard,  although  not  yet  sinking,  is  badly  listing  to  one  side.(Gavzer, 
2001) 

What  keeps  the  Coast  Guard  from  sinking  with  shrinking  budgets?  It  has  been  called  the 
Curse  of  Semper  Paratus  by  the  service’s  Commandant,  Admiral  James  M.  Loy.  Semper 
Paratus,  the  Coast  Guard  motto  meaning  Always  Ready,  has  induced  such  a  can  do  spirit  within 
Coast  Guard  personnel  that  its  members  refuse  to  accept  any  outcome  other  than  success.  (Loy 
1998)  In  other  words,  the  service’s  personnel  are  committed  to  ensuring  the  Coast  Guard  meets 
its  obligation  to  the  customer.  To  further  solidify  this  point,  and  despite  the  significant  cuts  in 
budget,  resources,  and  readiness,  the  Coast  Guard  was  even  designated  a  1999  Best  Business 
Partner  by  the  National  Partnership  for  Reinventing  Government  (NPR)  for  it’s  performance 
management  and  measurement  techniques.  Additionally,  in  1999,  the  Coast  Guard  was  lauded 
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by  the  Government  Accounting  Office  (GAO)  for  its  Risk  Management  practices  and  the 
restructure  management  approach  called  Managing  for  Results  .{hoy ,  2000)  So  what  is  the 
bottom  line  for  the  service?  With  little  fiscal  help  on  the  horizon,  the  Coast  Guard  has  an  obvious 
interest  in  evaluating  any  additional  enhancements,  improvements,  and  cost  reduction  programs. 
(Gavzer,  2001)  Just  as  in  the  DOD,  public  private  competition  can  be  one  of  those  tools  used  to 
conduct  streamlining  and  cost  minimization  in  the  Coast  Guard. 

A  key  to  any  competition  is  that  all  players  have  a  level  playing  field.  The  underlying 
premise  of  a  level  playing  field  is  that  public-private  competition  should  be  conducted  in  an  open 
and  fair  manner  so  that  the  process  does  not  provide  an  inherent  competitive  advantage  to  either 
the  public  or  private  sector.  Any  inability  of  the  public  entity  to  access  outside  assistance  tends  to 
tilt  this  level  playing  field  in  favor  of  the  private  sector.  (Martin,  1999)  The  term  level  playing 
field  can  also  be  called  competitive  neutrality.  The  term  means  designing  a  set  of  policies  and 
legal  arrangements  that  ensure  that  all  organizations  and  individuals  -public,  private,  and  non¬ 
profit-  are  treated  in  an  equal  manner  in  the  bidding  process  between  public  and  private 
bidders. (Eggers,  1998)  Simply  put,  the  level  playing  field  means  making  all  equal  for  purposes 
of  evaluation.  Just  because  a  private  and  public  organization  provides  similar  service  does  not 
indicate  that  they  can  be  evaluated  the  same  way  without  some  constructive  adjustments. 

Without  addressing  certain  factors,  the  public  private  competition  would  be  the  comparison 
of  apples  to  oranges  vice  apples  to  apples.  (Barber,  1998)  If  an  organization  were  to  be 
competitive  within  a  level  playing  field,  it  would  be  beneficial  to  concentrate  its  preparation 
resources  on  key,  important  factors  which  would  positively  effect  a  source  selection  decision  for 
that  organization.  So,  what  are  these  key  factors?  What  are  the  factors  that  any  potential  entry 
must  address  to  be  successful  in  a  managed  competition?  In  particular,  what  are  the  key  factors 
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that  a  public  entity  should  direct  resources  to  be  competitive  in  a  managed  competition?  The 
remaining  portion  of  this  literary  discussion  will  focus  on  describing  these  competitive  factors 
and  how  they  apply  to  competition  from  the  aspect  of  a  public  competitor. 

The  literature  has  provided  insight  into  the  development  of  a  model  reflective  of  these 
important  key  factors  that  a  public  entity  must  direct  resources  to  be  competitive.  Of  all  the 
many  topic  areas  discussed  and  researched  in  regards  to  managed  competitions,  they  all  seem  to 
fall  into  three  categories.  These  are  entitled  Cost,  Organic,  and  finally,  Politics.  A  visual 
description  of  this  model  can  be  seen  as  Figure  1.  It  should  be  noted  that  each  factor  is  topically 
dichotomous.  Together,  they  become  an  aggregate  research  model  that  can  be  used  by  a  public 
entity  to  baseline  competition  preparations.  The  discussion  will  first  focus  on  the  factor  of 
Politics. 
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Figure  1.  Key  Factors  to  Address  for  a  Competitive  Public  Organization 
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Figure  2.  Key  Factor  of  Politics 


Politics  Factor 

The  term  politics  is  used  to  describe  the  internal  and  external  communications  and  operations 
of  a  government  bureaucracy.  It  can  be  simply  defined  as  who  gets  what,  when  and 
how.(Pfeffer,  1996)  Additionally,  it  involves  those  activities  which  attempt  to  influence 
decisions  over  critical  issues  that  are  not  readily  resolved  through  the  introduction  of  new  data 
and  in  which  there  are  differing  points  of  view.(Pfeffer,  1996)  Probably  the  most  descriptive 
definition  for  this  study  defines  politics  as  intentional  acts  of  influence  to  enhance  or  protect  the 
self-interest  of  individuals  or  groups. (Allen  and  Madison,  1979)  For  this  study,  the  term  politics 
will  be  used  to  describe  the  protection  of  public  entity  self  interests  before  and  during  a  public 
private  competition. 

Mobilize  Congressional  Pressures  asainst  outsourcing  of  Public  Entity.  One  of  the  most 
obvious  and  powerful  tools  a  public  entity  has  available  in  its  toolbox  is  the  political  juggernaut 
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called  Congressional  Opinion.  As  the  legislative  branch  of  government,  Congress  is  most  able 
to  exert  its  influence  in  the  form  of  fiscal  appropriations  to  federal  bureaucracies.  These  federal 
bureaucracies,  or  departments,  fulfill  the  role  of  overarching  agencies  of  public  entities.  It 
should  be  clearly  understood  that  if  the  overarching  agency  wants  to  be  well  funded,  it  must 
adjust  its  policies  and  operations  to  fulfill  the  needs  and  issues  of  Congressmen  or  Senators. 
Congressional  membership  contains  elected  officials  each  having  their  own  constituency  and, 
therefore,  agenda  for  participating  in  the  institution  of  representative  government.  Generally,  it 
is  agreed  upon  in  the  literature  that  elected  officials  must  do  the  work  of  those  whom  elected 
them  to  office;  failure  to  not  represent  the  constituency  risks  the  official’s  reelection  and  the 
potential  loss  of  a  party’s  seat.  (Cook,  2001) 

A  great  example  of  this  political  procedure  is  the  1995  deliberations  on  the  Department  of 
Defense  (DOD)  Budget  of  1996.  In  those  deliberations,  a  House  and  Senate  conference 
committee  disagreed  with  the  DOD  announcement  which  discontinued  the  use  of  Public  Private 
Competitions.  At  this  time,  there  was  popular  agreement  among  lawmakers  for  increased  use  of 
competitions  to  decrease  overall  defense  costs  and  provide  opportunities  for  constituency 
businesses  to  compete  for  government  contracts.  Although  the  DOD  had  hard  cost  data  favoring 
the  discontinuation  of  this  program,  Congress  still  wished  to  see  the  program  active  and  pursuing 
their  goals.  As  a  result,  Congress  directed  the  DOD  to  reinstate  managed  competition  through 
linkages  attached  to  the  1996  National  Defense  Authorization  Bill.  Because  the  DOD  needed  to 
fully  fund  its  continued  operations  and  high-level  defense  acquisition  programs,  the  wishes  of 
Congress  were  quickly  addressed  as  a  departmental  policy  change.  (GAO,  1996) 

Public  entities  should  take  every  advantage  to  highlight  issues  most  dear  to  the  constituency 
within  which  it  operates  day  to  day.  Outsourcing  a  public  entity  can  have  drastic  effects  on  an 
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areas  economy,  infrastructure,  and  financial  worth,  in  particular,  if  the  public  entity  is  closed 
down.  If  an  outsourcing  opportunity  would  cause  harm  to  state,  county,  or  local  groups,  it 
should  be  addressed  and  highlighted  by  the  elected  officials;  in  particular,  those  assigned  key 
positions  in  the  appropriation  process.  Additionally,  every  effort  should  be  made  to  network  with 
other  state’s  public  entity  stakeholders  to  gain  political  capital.  The  key  is  to  aggressively  seek 
the  interest  of  “turf  protection”  bureaucrats;  these  are  Congressional  members  who  actively  seek 
to  gain  an  advantage  for  themselves  and  their  constituents. (Sapat,  1999) 

Utilize  the  influence  of  Private  Interest  Groups.  Private  interests  can  be  defined  as  politically 
motivated  entities  whose  membership  can  include  organizations  like  businesses,  unions, 
ideological  groups,  and  retirees.  These  private  interest  groups  face  a  tremendous  incentive  to 
become  active  in  the  political  sphere  in  order  to  pursue  govemmentally  conferred  benefits  or  to 
oppose  efforts  put  forth  by  others.  (DeBow,  1995)  The  pluralist  perspective  of  interest  group 
behavior  argues  that  public  policy  is  the  product  of  democratic  participation  by  individuals 
represented  by  organizations  such  as  business  and  interest  groups  (unions,  ideological  groups, 
citizen  groups).  These  theories  of  political  influence  on  legislators  and  bureaucrats  can  range 
from  narrow  views  of  influence  where  the  subject  group  holds  all  the  political  power,  to  more 
broad  definitions  where  the  interest  group  is  considered  to  have  no  more  power  than  other  actors 
in  the  political  process.  (Sapat,  1999)  In  this  study,  the  narrow  pluralist  perspective  will  be  used 
to  define  how  interest  and  business  groups  can  assist  with  preparing  a  public  entity  for 
competition.  For  purposes  of  example,  the  interest  groups  associated  with  industry  will  be 
presented  and  discussed  to  describe  its  contribution  to  the  political  factor. 

Industries  have  been  traditionally  viewed  as  a  major  player  with  interests  at  stake  in  the  policy 
choices  associated  with  outsourcing  and  privatization  decisions.  (Sapat,  1999)  Industry,  teamed 
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with  public  entities,  is  motivated  to  maintain  the  workload  and  increase  the  capability  of  the 
organization.  A  public  entity  in  business  means  the  public  contractor  will  continue  to  recover 
present  and  future  revenues.  Through  additional  streamlining  and  business  process 
improvement,  the  team  can  offer  the  best  of  both  worlds  and  be  extremely  competitive.  An 
excellent  example  is  the  San  Diego  Emergency  Medical  Service.  This  public/private  joint 
venture  easily  beat  out  its  competitors;  the  powerful  service  capability  provided  from  an 
integrated  public  fire  department  and  private  EMS  provider  was  a  key  attribute. (Eggers,  1998) 
Because  of  this  strong  incentive  to  remain  in  business,  the  door  opens  to  other  ways  of 
advertising  the  beneficial  work  industries  accomplish  for  overarching  agencies  and  local 
communities. 

A  popular  technique  includes  capturing  political  horsepower  through  influential  tools  such  as 
Political  Action  Committee  (PACs).  These  tools  link  the  issues  of  the  sponsor  interest  group  to 
elected  government  official(s)  via  financial  campaign  contributions.  Although  potential 
customers  of  the  results,  it  is  important  to  point  out  that  public  entities  do  not  participate  in  the 
tools.  Through  these  contributions,  it  is  hoped  the  elected  official  will  work  to  ensure  the  goals  of 
the  PAC  are  fulfilled. (DeBow,  1995)  Once  Congressional  support  is  obtained,  then  the 
overarching  agency  and  their  source  selection  teams  can  be  addressed  indirectly  through 
appropriations,  or  sometimes,  directly  to  the  source  selection  team  members  themselves. 

Contrary  to  popular  belief,  heavy  group  and  individual  source  selection  team  soliciting  does  take 
place,  and  Congressional  staffers  representing  their  superior’s  objectives  usually  conduct  it. 
(Stockman,  2001)  In  the  case  of  a  public  private  competition,  it  would  be  the  ultimate  hope  that 
an  overarching  agency’s  outsourcing  decision  would  be  effected  by  the  larger  agenda  of  the 
elected  official.  So,  where  and  how  can  this  take  place? 
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Called  a  Public/Private  Bidding  Consortium,  private  companies  have,  in  the  past  at  the  state 
level,  teamed  up  with  existing  public  entities  to  bid  against  other  private  providers  in 
competitions.  (Eggers,  1998)  The  U.S.  Coast  Guard  Aircraft  Repair  and  Supply  Center  (ARSC) 
is  a  perfect  example  of  a  public -private  team  that  could  benefit  from  a  Public/Private  Bidding 
Consortium.  Presently,  the  depot’s  industrial  teammates  include  such  international  corporations 
as  Allied  Signal,  American  Eurocopter,  Dassault  Falcon  Jet,  and  Sikorsky;  additionally,  this  list 
does  not  include  all  of  the  many  regional  based  contractors  who  rely  upon  depot  work 
assignments  to  remain  in  business.(AR&SC,  2000)  This  compilation  of  companies  could  field  a 
powerful  political  lobby  with  the  goal  of  continued  and  uninterrupted  Coast  Guard  aircraft 
overhaul  and  aviation  support. 

A  good  example  of  private  interest  group  operations  took  place  in  1 995  during  a  round  of  the 
Base  Realignment  and  Closure  program  (BRAC).  Upon  the  recommendations  of  the  BRAC 
committee,  the  Louisville  Detachment  of  the  Naval  Surface  Warfare  Center,  a  weapons  depot, 
was  selected  for  closure.  The  plan  was  to  have  the  depot’s  business  broken  up  to  fill  excess 
capacities  in  other  DOD  depots  around  the  country.  Concerned  with  the  potential  economic 
impact  of  this  decision,  the  city  of  Louisville  and  the  two  original  contractors,  Flughes  Missile 
Systems  Company  and  United  Defense  Limited  Partnership,  teamed  up  to  create  a  privatize-in- 
place  proposal.  Together  as  a  team,  they  submitted  the  proposal  unsolicited  to  the  Navy  with  the 
goal  of  keeping  the  depot  operational  in  Louisville.  Although  the  proposal  was  not  obtained 
through  the  standard  contracting  procedures  for  outsourcing,  the  Navy  accepted  the  proposal 
with  interest,  and  awarded  the  consortium  a  contract,  therefore,  reversing  its  original  decision  on 
closure.  A  large  factor  in  this  reversal  was  the  political  support  obtained  from  the  Navy  itself. 
The  two  large  companies  that  made  up  the  solicitation  were  original  equipment  manufactures 
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that  built  and  supported  those  same  weapons  systems  overhauled  in  Louisville.  This  fact  of 
maintaining  original  contractor  experience,  together  with  the  Navy’s  concern  over  the  local 
community  impact,  was  key  to  the  closure  turnaround.  (GAO,  1996)  Although  the  proposal 
ended  up  being  questionable  in  regards  to  cost  effectiveness  to  the  Navy,  the  bottom  line  was  it 
kept  the  Navy’s  funding,  and  therefore  jobs,  in  the  state  of  Kentucky. 

Politics  can  be  an  extremely  powerful,  yet  often  overlooked,  tool  for  use  in  proposal 
preparation.  For  a  public  entity  to  be  competitive,  the  proper  integration  of  Congressional 
pressures  and  private  interest  groups  can  be  a  tool  unlike  no  other  used  in  preparation  for  a 
managed  competition.  Its  application  demands  to  be  highlighted  and  addressed  as  a  key  factor 
which  makes  a  Public  Entity  competitive.  The  next  section  will  discuss  the  Cost  Factor  of  the 
research  model. 

The  following  is  a  synopsis  of  key  points  under  the  Politics  Factor.  Each  sub  factor  is 
broken  further  into  sub  points.  This  review  will  take  place  after  each  section  to  further  instill  the 
significance  of  each  key  factor  of  the  research  model. 
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POLITICS  FACTOR 


Mobilize  Congressional  Pressure  against  Outsourcing  of  Public  Entity 
-Linkage  of  Congressional  Opinion  and  the  Overarching  Agency 
-Power  of  Local  Constituency  in  Directing  Congressional  Agendas 

-Negative  Effects  on  Congressional  members  and  Constituency  if  Public  Entity  is  Outsourced 
-Aggressive  Pursuit  and  Utilization  of  "Turf  Protection"  Bureaucrats 


Utilize  the  Influence  of  Private  Interest  Groups 

-Use  of  Narrow  Pluralist  View  to  explain  Role  of  Private  Interest  Groups 
-Industry  Groups  as  Major  Player  in  Public  Private  Competition 
-Capitalize  on  Political  Horsepower  through  use  of  Influential  Political  Tools 
-Use  of  Public/Private  Bidding  Consortium  in  Managed  Competition 


Figure  3.  Key  Factors  and  Sub  Factors  of  Politics 
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COST  FACTOR 


Apply  an  Activity  Based  Cost  Managerial 
Accounting  System 

Avoid  Common  Cost  System  Mistakes 

Use  Consultants  to  Integrate  a  Cost  System 

Reengineer  to  become  more  Cost  Competitive 

Transition  Cost  System  into  a  Competitive 
Cost  Proposal  Structure 


Figure  4.  Key  Factor  of  Cost 


Cost  Factor 

Reducing  cost  is  one  of  the  primary  reasons  the  government  utilizes  the  tool  of  public-private 
competition.  In  particular,  the  government  uses  public-private  competition  to  reduce  service 
delivery  costs  of  public  departments.  The  cost  of  public  service  delivery  can  be  defined  as  the 
sum  of  the  applicable  direct  costs  plus  an  allocated  proportion  of  indirect,  or  overhead 
costs.  (Martin,  1999)  In  managed  competitions,  cost  becomes  one  of  the  premier  issues  when 
conducting  the  comparison  with  a  private  entity,  however,  a  problem  lies  in  determining  how 
those  costs  are  captured  and  how  they  are  allocated  in  the  public  organization.  (Martin,  1999) 

An  overarching  agency’s  source  selection  team  will  be  evaluating  a  cost  proposal  for 
Completeness,  Realism,  and  Reasonableness.  Completeness  assesses  the  level  of  detail  the 
offeror  provides  in  cost  information  required  by  the  Request  for  Proposal  or  RFP;  a  RFP  is 
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defined  as  a  standard  format  to  communicate  government  requirements  to  prospective 
contractors  and  to  solicit  proposals  or  quotations  from  them.(Amavas  and  Ruberry,  1999)  The 
realism  of  a  bid  is  evaluated  by  assessing  the  compatibility  of  proposal  costs  with  proposal  scope 
and  effort.  In  other  words,  can  the  proposal  cost  be  considered  normal  for  a  particular  size  of 
service  or  product?  (Amavas  and  Ruberry,  1999)  Finally,  reasonableness  is  evaluated  for  the 
purpose  of  determining  whether  a  cost  is  appropriate  or  allowable  for  the  evaluation.  The 
Federal  Acquisition  Regulations  (FAR)  provides  that  a  cost  is  considered  reasonable  if,  in  its 
nature  and  amount,  it  does  not  exceed  that  which  would  be  normally  incurred  by  a  prudent 
person  in  conduct  of  competitive  business.  (Amavas  and  Ruberry,  1999)  As  the  public  team 
develops  a  cost  proposal,  these  three  attributes  should  be  used  as  a  guide  from  which  to  measure 
their  accounting  procedures  and  results. 

Before  further  discussions  of  what  costs  need  to  be  addressed  to  ensure  a  public  proposal  is 
competitive,  one  must  take  a  look  at  the  system  of  cost  accounting  needed  to  be  competitive. 
Why  bother  with  a  cost  system  at  all?  Three  points  can  answer  this.  First,  the  public  entity  must 
determine  the  real  in-house  costs  of  delivering  the  public  service. (Eggers,  1998)  Secondly,  these 
costs,  once  identified,  are  required  to  effectively  identify,  justify,  and  implement  business 
process  improvement  programs. (O'Guin,  1991)  Finally,  third,  total  cost  of  the  service  or 
product  is  used  as  one  of  the  key  decision  factors  during  source  selection  evaluations. (Stockman, 
2001) 

Apply  an  Activit v  Based  Cost  Managerial  Accountins  System.  In  order  for  public  agencies 
to  make  an  informed  decision  about  competitive  contracting,  they  must  first  identify  the  total 
cost  of  their  in-house  service  or,  simply,  their  full  cost.  Identifying  the  costs  associated  with  the 
product,  process,  and  customer  is  necessary  to  ensure  the  source  selection  team  can  conduct  a 
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fair  evaluation;  more  importantly,  true  costs  allow  the  public  entity  to  be  competitive  with 
private  proposals.(Greenough  and  Eggum,  1999)  In  this  context,  true  costs  are  considered  those 
that  accurately  reflect  resource  usage  by  the  product  or  service.  In  other  words,  there  is  a  linkage 
between  the  product  or  service  and  the  indirect  costs  they  create.(0'Guin,  1991)  Presently,  most 
government  organizations  have  no  concept  of  what  a  service  or  product  costs  them;  it  has  no 
system  in  place  to  capture  these  true  costs  of  doing  business. (Eggers,  1998)  Typically,  the  only 
cost  tools  available  to  public  organizations  are  based  on  the  budget  allocation  process  developed 
using  direct  labor  hours  as  a  cost  driver. (Greenough  and  Eggum,  1999)  Lost  are  the  costs 
associated  with  overhead  and  other  indirect  costs  such  as  those  associated  with  administration 
procedures  and  capital  setups.  (O'Guin,  1991) 

To  be  competitive,  a  system  is  required  that  is  capable  of  capturing  these  true  costs  and 
providing  upgraded  information  for  decision-making.  Without  this  cost  data,  any  submitted 
proposal  will  potentially  misrepresent  the  public  entities  capabilities,  process  improvements,  and 
cost  efficiency.  In  some  past  public-private  competitions,  public  agencies,  which  had  elected  to 
base  their  costs  on  direct  labor  hours  only,  submitted  proposals  that  were  found  to  be  unrealistic 
in  comparison  with  private  entities.  (Eggers,  1998)  Without  properly  allocating  the  overhead, 
service  and  product  costs  will  be  deceptive,  distorted,  and  unreliable  for  evaluation 
purposes. (O'Guin,  1991) 

So  is  there  a  system  that  can  account  for  these  true  costs?.  The  answer  is  yes;  it  exits  in  a 
system  called  Activity  Based  Costing  (ABC).  ABC  is  a  managerial  cost  system  based  on  the 
goals  of  understanding  and  controlling  indirect  costs.  ABC  assigns  costs  of  activities  such  as 
setting  up  a  machine,  receiving  raw  materials,  scheduling  a  job,  and  then  traces  these  activities  to 
a  particular  product  or  customer  that  triggers  the  activity.  As  a  result,  the  product  or  service 
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costs  embody  the  total  cost  of  these  activities.  The  key  to  this  system  is  overhead  cost  allocation; 
these  indirect  costs  can  be  traced  to  a  particular  product  rather  than  spread  arbitrarily  across  all 
products.  (O'Guin,  1991) 

ABC  provides  public  management  with  the  ammunition  to  be  competitive.  As  a  system, 

ABC  can  cost  products,  develop  budgets,  measure  performance,  and  value  inventories.  It  can 
assist  the  public  managers  with  cost  strategy  creation;  it  provides  information  necessary  for 
public  managers  to  make  quality  improvements  and  structure  business  practices  to  better  meet 
the  customer’s  needs.  ABC  is  a  management  tool,  not  a  reporting  tool.  It  does  not  attempt  to 
capture  the  historical  costs  or  those  costs  that  have  already  occurred  over  time.  This  is  the  duty 
of  traditional  cost  accounting  developed  to  report  costs  in  the  standard  formats  expected  for  the 
business  environment.(0'Guin,  1991)  .  Although  considered  a  challenging  paradigm  shift  for 
most  government  agencies,  ABC  integration  will  provide  the  public  competitor  with  reliable, 
true  costs  from  which  it  can  improve  processes  and  eventually  base  its  cost  proposal. 

Avoid  Common  Cost  System  Mistakes.  Applying  this  cost  system  to  a  public  entity  such  as 
a  depot  will  have  its  challenges.  There  are  many  mistakes  that  have  been  made  in  the  past  when 
a  public  entity  attempts  to  conduct  a  cost  analysis  to  find  total  in-house  costs.  Some  common 
examples  include  cross  subsidization,  failure  to  allocate  overhead,  failure  to  disclose  all  costs, 
and  finally,  failure  to  obtain  worker  buy-in.  Cross  subsidization  occurs  when  costs  of  a  target 
department  are  borne  by  other  departments  in  the  same  agency;  these  costs  are  not  reported  as  a 
target  department’s  expense.  Failure  to  allocate  overhead  is  simply  the  failure  to  properly 
identify  the  user  of  the  indirect  resource.  Examples  of  these  frequently  overlooked  overhead 
areas  include  administration  costs,  personnel  payroll  costs,  and  capital  costs.  Additionally,  there 
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is  failure  to  disclose  all  costs.  The  private  entity  should  make  every  effort  to  ensure  there  are  no 
hidden  costs  associated  with  the  cost  proposal. (Eggers,  1998) 

Finally,  before  it  even  gets  started,  the  inability  to  obtain  worker  buy-in  can  stop  the  cost 
system  deployment.  A  cost  system  cannot  operate  without  the  inputs  of  the  worker;  he  must 
believe  that  a  fully  operational  cost  system,  trusted  and  used  daily,  is  in  his  best  interest.  The 
challenge  of  management  is  to  properly  convey  this  information.  The  workforce  should  be 
provided  with  corporate  knowledge  of  what  could  potentially  result  from  not  learning  the  new 
system.  It  must  understand  the  fact  that  a  lost  competition  results  in  lost  jobs.  If  integrated 
properly  into  an  organization,  an  ABC  system  will  ensure  that  these  mistakes,  and  others,  are  not 
made  to  the  detriment  of  the  public  entity’s  competitiveness.(0'Guin  1991) 

Use  Consultants  to  Integrate  a  Cost  System.  To  avoid  these  mistakes,  the  literature  suggests 
implementing  a  cost  system  using  outside  assistance  or  business  consultants.  (Eggers,  1998) 
Private  corporations  routinely  utilize  the  services  of  consultants  during  public  private 
competition  preparations.  Because  of  this,  the  public  entity  should  be  afforded  the  same 
opportunity  to  access  this  corporate  experience.(Martin,  1999)  The  purpose  of  consultants  is  to 
integrate  their  knowledge  of  business  reengineering,  cost  systems,  and  competitive  proposal 
development  with  the  existing  organizational  experience.(Barber,  1998)  The  consultants  should 
be  hired  to  assist,  not  just  train,  the  pubic  teams  in  preparing  the  actual  cost  proposal  and 
reengineering-cost  cutting  operations.(0'Guin,  1991)  Since  this  is  an  additional  cost  to  the 
government  and  one  normally  included  in  private  proposals,  the  consultant  fees  should  be 
included  in  the  public’s  total  bid  price.  (Eggers,  1998) 

The  lack  of  outside  expertise  has  been  listed  as  one  of  the  top  reasons  why  the  public  sector 
fails  to  implement  any  system  to  account  for  costs.(Eggers,  1998)  Why  is  this  issue  such  a  threat 
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to  the  public  performance  in  a  unbiased  competition  or,  to  put  it  another  way,  the  public  sector’s 
performance  on  a  level  playing  field?  The  underlying  premise  of  a  level  playing  field  is  that 
public-private  competition  should  be  conducted  in  an  open  and  fair  manner  so  that  the  process 
does  not  provide  an  inherent  competitive  advantage  to  either  the  public  or  private  sector.  Any 
inability  of  the  public  entity  to  access  outside  assistance  tends  to  tilt  this  level  playing  field  in 
favor  of  the  private  sector.  (Martin,  1999)  It  is,  therefore,  in  the  best  interest  of  a  public  entity  to 
ensure  consultants  are  key  teammates  in  the  development  of  an  effective  costs  management 
system. 

Reensineer  to  become  Cost  Competitive.  Redesigning  processes,  .streamlining  processes,  and 
cutting  costs  through  improvement  initiatives  is  a  way  to  become  more  efficient  and  competitive. 
The  management  of  a  public  entity  must  take  a  look  at  the  agency’s  processes  to  see  if  there  are 
any  ways  to  improve  the  delivery  of  its  product  or  service.(Hammer  and  Champy,  2001)  For 
purposes  of  this  study,  a  process  is  defined  as  “a  collection  of  activities  that  takes  one  or  more 
kinds  of  input  and  creates  an  output  that  is  of  value  to  the  customer.”(Hammer  and  Champy, 
2001) 

This  improvement  to  business  processes  cannot  just  take  place  arbitrarily.  The  cost  system 
employed  will  need  to  provide  accurate  data  to  benchmark  and  justify  quality  improvement 
efforts.  Once  allocated,  these  costs  will  be  then  used  to  identify  and  target  high  cost  or  broken 
processes  for  managerial  attention.  The  overall  goal  will  be  to  lower  the  costs  of  doing  business, 
and  increase  the  value-added  to  the  customer  by  addressing  the  weaknesses  in  the 
organization. (O'Guin,  1991)  It  is  simply  an  act  of  making  the  pubic  organization  more  efficient, 
and  ,  hopefully,  more  effective.  To  assist  meeting  these  goals,  technology,  as  a  principle  of 
process  redesign,  should  also  be  integrated  to  its  fullest  extent  possible  during  the  redesign 
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procedure.  As  defined  by  the  literature,  reengineering  is  the  fundamental  rethinking  and  radical 
redesign  of  business  processes  to  achieve  dramatic  improvements  in  critical,  contemporary 
measures  of  performance,  such  as  cost,  quality,  service,  and  speed. (Hammer  and  Champy,  2001) 
With  true  costs  associated  with  its  reengineered  processes,  the  public  entity  will  then  finally  be 
able  to  present  itself  as  streamlined,  efficient,  and  cost  effective  in  a  competitive  cost 
proposal. (GAO,  1997) 

Finally,  one  point  should  be  kept  ever  present  in  the  minds  of  the  public  managers.  The 
private  sector  can  be  expected  to  have  an  extremely  cost  effective  proposal  due  its  own 
experience  in  the  competitive  business  environment.  (Eggers,  1998)  As  a  result,  public 
managers  must  assume  that  the  private  cost  proposals  will  be  polished,  professional,  and 
extremely  competitive.  It  must  be  remembered  that  these  private  corporations  deserve  respect; 
they  did  not  become  successful  without  knowing  how  to  competitively  cost  and  market  their 
product  or  service.  (Greenough  and  Egguni,  1999) 

Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure.  Once  a  cost  system  is  in 
place  and  operating  in  a  public  organization,  only  then  can  its  output  be  used  to  supply  the 
competitive  framework.  Source  selection  officials  strive  to  ensure  as  much  equality  as  possible 
for  each  component  of  a  procurement  process,  ranging  from  determining  current  in-house  true 
costs  to  defining  the  consequences  of  performance  failure.  Although  the  perfect  level  playing 
field  can  never  be  attained,  governments  conducting  a  public-private  competition  should  strive  to 
get  as  close  as  possible  to  this  equal  comparison. (Eggers,  1998)  In  a  public  private  competition, 
the  overarching  agency  attempts  to  reach  this  goal  by  utilizing  a  vehicle  called  the  Request  for 
Proposal  (REP).  An  REP  is  used  to  communicate  Government  requirements  to  prospective 
contractors  and  to  solicit  proposals  or  quotations  from  them.  (Amavas  and  Ruberry,  1999)  In 
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other  words,  it  is  a  comprehensive  and  formal  list  of  directives  detailing  the  proposal  structure. 

In  its  entirety,  an  RFP  is  important  because  it  creates  the  baseline  for  a  common  accounting  of 
evaluation  factors.  This  forces  the  competitors,  both  private  and  public,  to  develop  and  present 
their  proposal  in  a  format  requested  by  the  sponsoring  agency;  each  competitor  will  fully  know 
the  relative  importance  assigned  each  factor.  (Amavas  and  Ruberry,  1999)  Because  of  this 
proposal  standardization,  implementing  the  RFP  begins  addressing  the  issue  associated  with 
competitive  neutrality.  Therefore,  as  a  sub-section  of  this  document,  the  RFP  cost  section  can  be 
considered  a  standardized  cost  template  to  assist  with  creating  this  level  playing  field. (Council, 
1998) 

A  great  example  of  this  neutrality  driver  is  the  1997  U.S.  Air  Force  San  Antonio  Air 
Logistics  Center  (ALC)  C-5  Galaxy  Overhaul  Public-Private  Competition.  As  a  result  of  the 
1995  Base  Realignment  and  Closure  (BRAC)  decision,  the  San  Antonio  ALC  was  directed  to 
close  by  the  end  of  July  2001.  Because  of  concerns  over  excess  capacity  at  the  three  remaining 
Air  Force  depots,  the  Air  Force  announced  a  strategy  which  allowed  those  remaining  facilities  to 
compete  against  private  corporations  for  the  C-5  overhaul  business.  The  result  was  a  highly 
competitive  evaluation  that  awarded  the  contract  worth  $  1  Billion  dollars  to  a  public  contender, 
Warner  Robbins  Air  Logistics  Center.  In  this  competition,  the  public  depot  was  selected  over 
two  large  and  extremely  capable  private  corporations.  (GAO,  1998) 

The  USAF  was  complimented  by  the  Government  Accounting  Office  (GAO).  The  GAO 
comments  concluded  that  this  competition  provided  an  equal  opportunity  for  public  and  private 
offerors  to  compete  without  regard  to  where  work  could  be  performed.  Additionally,  the 
procedures  did  not  appear  to  deviate  in  any  material  respect  from  applicable  laws  or  the  Federal 
Acquisition  Regulations.  Finally,  the  competition  was  based  on  Air  Force  assumptions  and 
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conditions  at  the  time  of  the  award;  the  award  resulted  in  the  lowest  total  cost  to  the  government. 
(GAO,  1998)  Because  of  this  statement  made  by  the  GAO,  and  due  to  the  availability  of 
excellent  data  for  review,  this  study  will  be  used  as  a  case  to  benchmark  functional  cost  areas 
necessary  to  conduct  a  neutral  and  fair  evaluation. 

The  cost  proposals  for  the  competition  were  evaluated  utilizing  total  costs  based  on  a  source 
selection  framework  recommended  by  the  U.S.  Air  Force  Cost  Comparability  Flandbook  or 
CCH.  The  CCH  is  the  Air  Force’s  effort  to  provide  guidance  on  a  standard  set  of  Cost 
Guidelines.  The  purpose  of  the  handbook  is  to  provide  standardized  procedures  and  techniques  to 
insure  cost  comparability  during  consolidation  studies  and  when  competing  depot  maintenance 
workloads  between  DOD  components  and  between  organic  (DOD)  sources  and  the  private. 
(Council,  1998) 

Additionally,  the  CCH  states  “There  are  some  differences  in  accounting  for  costs  between  the 
Services  and  even  between  different  locations  within  the  same  Service.  These  variances  are  a 
result  of  the  managerial  and  organizational  philosophy  of  the  respective  Service.  These 
differences  must  be  addressed  in  order  to  level  the  playing  field  before  workloads  can  be 
compared  or  competed  between  Services  and  private  industry.”(Council,  1998)  In  the  C-5 
competition,  the  CCH  provided  the  Air  Force  source  selection  team  with  the  framework 
necessary  to  evaluate  not  only  total  cost  of  the  service,  as  provided  in  the  proposal,  but  also  the 
costs  which  account  for  the  differences  between  the  proposal.  For  example,  during  the  C-5  case, 
the  Warner  Robbins  ALC  had  an  aircraft  depot  proposal  on  the  table;  it  included  the  cost  of  test 
pilots.  The  private  corporations,  on  the  other  hand,  did  not  include  that  cost  in  their  submitted 
proposal.  To  obtain  this  level-playing  field  for  evaluation,  the  source  selection  team  adjusted  the 
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public  proposals  downward  to  account  for  this  cost  differential.  In  simplest  terms,  the  CCH 
provides  the  source  selection  team  and  proposal  owners  a  tool  to  provide  competitive  neutrality. 

This  cost  proposal  framework  is  broken  into  sections  of  Direct  Labor,  Direct  Material,  other 
Direct,  Production  Overhead,  General  &  Administrative.  The  following  is  a  short  definition  for 
each  functional  cost.  It  should  be  noted  that  these  cost  definitions  are  agreed  upon  when  the 
offeror  submits  a  proposal  addressing  the  RFP.  (Amavas  and  Ruberry,  1999)  These  were  taken 
directly  from  the  CCH.  It  is  interesting  to  note  that  the  functional  cost  sections  tend  to  define 
themselves  using  aspects  of  ABC  cost  allocation  methodology. 

Direct  Labor.  Work  performed  solely  for  the  benefit  of  a  single  specific  job  order  as 
provided  by  engineering  estimates.  The  number  of  direct  labor  hours  (civilian  and  military) 
chargeable  to  a  job  order  are  only  those  incurred  during  the  period  of  time  that  benefits  accrue 
solely  to  that  specific  job  order.  All  other  labor  hours  (civilian  and  Military)  shall  be  recorded  as 
indirect. 

Direct  Material.  Material  and  supplies  that  can  be  identified  as  specifically  required  for 
the  performance  of  work  as  specified  by  a  work  authorization  document  and  /  or  Bill  of  Material 
(BOM).  A  small  item  of  insignificant  material  may  be  treated  as  indirect  material  even  though 
the  item  is  incorporated  as  a  part  of  the  final  product,  if  this  practice  is  consistently  applied  from 
job  order  to  job  order.  Direct  material  may  either  be  incorporated  as  part  of  the  final  product  or 
consumed  in  the  maintenance  process. 

Other  Direct  Costs.  Purchased  services  shall  be  charged  as  direct  costs  to  the  benefiting 
job  order.  If  only  one  job  order  benefits  from  a  contract  or  purchase,  the  cost  of  the  contract 
shall  be  charged  to  that  job  order.  If  more  than  one  job  order  benefits  from  a  contract,  the  cost  of 
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the  contract  shall  be  prorated  to  the  benefiting  job  orders  based  upon  estimates  or  calculations  of 
the  benefits  received  by  each  job  order. 


(1)  The  cost  of  contracts  that  supplement  capacity  or  capability  for  the 
depot  shall  be  charged  to  the  job  orders  that  use  the  additional 
maintenance  services. 

(2)  Travel  and  per  diem  expenses  including  regular  labor  hours  spent  in 
travel  shall  be  charged  as  other  direct  costs  only  if  the  labor  hours 
worked  while  traveling  are  charged  as  direct  labor.  If  more  than  a 
single  job  order  is  worked  on,  the  travel  and  per  diem  expenses  shall 
be  prorated  on  the  basis  of  the  related  direct  labor.  Otherwise,  all 
travel  and  per  diem  expenses  shall  be  charged  as  an  indirect  expense 
of  the  employees  cost  center. 

The  indirect  costs  are  broken  out  by  the  CCH  to  include  the  following  Indirect  Functional 
Areas.  The  all-inclusive  list  may  be  reviewed  in  the  CCH. 

Production  Support  Function.  This  are  all  costs  that  are  associated  with  the  creation  of  the 
service  or  the  product.  Examples  can  include  First  Line  Supervisors,  Tools  Management, 
Equipment  Handlers,  and  Test  pilots.. 

Other  Indirect  Functions.  These  are  costs  of  conducting  finance.  These  include 
Comptroller  Services,  Accounting,  Budget  Costs,  and  Finance.  Others  include  the  cost  of 
communications  services;  aircraft  support  services,  and  data  processing. 

Facility  Support  Functions.  These  are  costs  associated  with  facility  upkeep  and 
maintenance.  Examples  include  Police  services.  Fire  services,  Utilities,  and  Base  Facility  Repair 
Service. 
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Equipment  Management  Functions.  These  costs  that  can  include  Production  Equipment 
maintenance.  Motor  Pool  Maintenance,  equipment  calibration  and  equipment  rental. 

Indirect  Labor  Costs.  The  costs  can  include  the  Indirect  time  of  Direct  labor  (work  delays, 
safety  meetings,  training  meetings  ect.),overtime  pay,  holiday  pay,  and  benefits. 

Material  Adjustments.  These  are  the  costs  associated  with  material  accounting.  Examples 
include  the  costs  associated  with  inventory  adjustments,  order  cancellations,  and  the  cost  of 
quality  or  scrap  material. 

Depreciation/ Amortization.  Examples  of  these  costs  include  the  depreciation  on 
equipment  and  facility  construction. 

Non-DoD  Functions.  These  are  costs  which  are  associated  with  outside  of  the  DoD.  These 
include  State  Unemployment  payments,  Impact  Aid  (education  aid  for  local  communities  of 
military  facilities),  and  Insurance. 

Excluded  Support  Activities.  These  are  costs  which  the  CCH  identifies  as  a  non-player  in 
the  organic  cost  of  a  depot.  Examples  include  Chaplin  Services,  Commissary,  and  Community 
Support  Services. 

It  is  important  to  again  point  out  that  the  CCH  was  developed  to  provide  guidelines  in  a 
public-private  competition  for  depots  workloads.  Although  the  depot  processes  are  not 
necessarily  the  same  as  other  public  entities  and  workloads,  a  public  depot  competition  can  be 
considered  to  be  one  of  the  most  complicated  and  dynamic  source  selection  efforts.  (Stockman 
2001)  It,  therefore,  can  be  assumed  that  the  similar  problems  associated  with  conducting  a  depot 
competition  will  most  certainly  be  a  factor  in  other  workload  competitions.  Although  stated  that 
it  was  not  designed  for  other  efforts  specifically,  the  CCH  cost  allocations  can  certainly  be  used 
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as  a  reference  template  for  competitive  neutrality  in  any  workload  or  line  of  business.  (Council 
1998) 

The  CCH  was  a  key  to  the  highly  visible,  highly  successful  C-5  Overhaul  Competition.  By 
selecting  a  public  depot,  the  source  selection  process  verified  that  these  functional  cost  areas  can 
be  successfully  presented  and  evaluated  in  a  manner  conducive  to  creating  a  level  playing  field. 
Because  of  this,  these  functional  cost  areas  are  required  factors  to  consider  in  the  development  of 
a  competitive  public  proposal.  The  Organic  Factor  will  next  be  examined  as  a  key  for  making 
competitive  a  pubic  entity. 


37 


The  following  figure  details  the  review  of  the  Cost  Factor  Section. 


COST  FACTOR 


Apply  a  Managerial  Accounting  System 

-  System  must  allow  Entity  to  make  Informed  Decisions  based  on  True  Costs  of  Product  or  Service 

-  System  must  identity  Full-Cost  or  Total  Cost  (Indirect  and  Direct  Costs) 

-  System  must  Allocate  Cost  to  Product  or  Service  that  Consumes  the  Entity  Resources 

-  System  must  avoid  Distorted  Costs  associated  with  the  Misallocation  of  Overhead  Costs 

-  Activity  Based  Costing  is  an  Alternative  to  meet  these  Tasks 


Avoid  Common  Mistakes 

-  Cross  Subsidization  of  Overhead 

-  Failure  to  Allocate  Overhead  Properly  causing  Distortions 

-  Failure  to  Disclose  All  Costs 

-  Failure  to  Obtain  Worker,  and  Management  Hierarchy  Buy-In  of  Managerial  Accounting  System 


Use  Consultants  to  Integrate  a  Cost  System 

-  Use  Assistance  to  avoid  Common  Mistakes 

-  Obtain  Corporate  Experience  of  Competitors  via  Consultants 

-  Consultants  integrate  with  a  Management  Team,  They  do  not  simply  train  the  Team 

-  Lack  of  Expertise  his  one  of  Top  Reasons  Public  Entities  fail  to  implement  Cost  Systems 

-  No  Outside  Assistance  tilts  the  Level  Playing  Field  in  direction  of  Private  Entity 


Reengineer  to  become  Cost  Competitive 

-  Process  Redesign,  Streamlining,  and  Improvements  are  ways  to  become  more  Efficient  and  Effective 

-  Overall  Goal  of  Reengineering  is  to  Lower  Business  Costs  and  Increase  Value  Added  to  the  Customer 

-  Technology  must  be  integrated  whenever  possible  to  assist  in  Redesign  Effort 

-  Reengineering  provides  Tools  necessary  for  Public  Entities  to  match  Professional  Level  of  Private  Proposals 


Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 

-  In  Place  Cost  System  is  required  to  supply  Cost  Input  to  a  Competitive  Framework 

-  Level  Playing  Field  drives  Cost  Structure  via  Request  for  Proposal  (RFP) 

-  RFP  provides  Standardized  Cost  Proposal  Framework  to  Pubic  Entity 

-  Cost  Comparability  Handbook  (CCH)  of  standard  cost  procedures  should  be  used  to  integrate  costs 

-  CCH  should  provide  direction  to  Public  Teams  on  how  differences  in  entity  proposals  are  addressed 

-  CCH  should  provide  Framework  that  addresses  Direct  Functional  Cost  Areas 

-  CCH  should  provide  Framework  that  addresses  In-Direct  Functional  Cost  Areas 


Figure  5.  Key  Factors  and  Sub  Factors  of  Cost 
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ORGANIC  FACTOR 


Figure  6.  Key  Factor  of  Organic 


Organic  Factor 

In  the  context  of  this  model.  Organic  means  internal  to  the  organization.  In  this  study,  the 
infrastructure  of  the  public  organization  will  be  observed  as  a  factor  that  should  be  addressed 
prior  to  a  public  private  competition.  Firms  succeed  by  taking  advantage  of  what  they  do 
particularly  well.  Every  agency  has  in  itself  inherent  strengths  that  can  be  improved  and 
capitalized  upon  to  make  the  organization  more  competitive  in  direct,  or  overhead  costs.  Called 
core  competencies,  these  strengths  are  generally  referred  to,  in  the  private  sector,  as  those 
activities  an  organization  conducts  which  make  it  an  industry  leader.  (Hammer  and  Champy, 
2001)  They  are  an  organization’s  unique  resources  and  strengths  which  management  considers 
when  formulating  strategy.  In  the  public  realm,  this  definition  can  be  further  refined  to  indicate 
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the  work,  equipment,  and  procedures  that  produce  the  valuable  product  or  service  consumed  by 
an  overarching  agency.  Core  competencies  rely  on  the  knowledge  that  is  gained  over  many 
years  of  experience,  and  the  cadre  of  first  class  people  who  follow  the  literature  and  stay  abreast 
of  new  external  knowledge.  (Krajewsiki  and  Ritzman,  2001)  Because  this  takes  place  in  a 
public  organization,  it  is  important  to  recognize  these  particular  aspects  are  potential  competitive 
strengths. 

By  identifying  these  core  competencies,  the  public  organization  can  further  improve  their 
operations  and,  therefore,  value  to  the  outsourcing  agency.  For  example,  as  a  result  of  a  1988 
Naval  public  private  competition  for  F-14  Tomcat  airframe  overhauls,  in  which  the  pubic  depot 
was  the  winner,  the  Norfolk  Naval  Aviation  Depot  (NADEP)  went  from  a  two  shift  operation  to 
a  one  shift  operation  and  reduced  the  number  of  personnel  assigned  to  the  program.  In  this 
process,  Norfolk  reduced  the  F-14  production  staff  by  over  100  people  through  recognition  of 
their  competence  and  familiarity  with  the  Tomcat  airframe.  Additionally,  further  cost  awareness 
and  control  changes  were  made  to  these  processes  to  increase  the  competitiveness.  In  order  to 
submit  the  lowest  possible  bid  with  the  highest  overall  value,  the  depot’s  overhead  utilization 
was  increased  through  streamlining,  and  key  work  processes  completed  and  integrated  process 
improvement  programs.  Simply  speaking,  the  Norfolk  NADEP  successfully  endeavored  to  wipe 
out  all  non-value  added  tasks  associated  with  the  repair  and  overhaul  of  this  legacy  fighter 
aircraft.  Naval  officials  stated  that  the  measures  adopted  by  the  NADEP  in  response  to 
competition  caused  the  depot  to  become  more  business  like,  with  an  increased  focus  on 
efficiency  of  core  competencies  and  bottom  line  results.  (GAO,  1996) 

Highlight  Overhead  and  Excess  Capacity.  A  public  organization,  in  particular  those 
responsible  for  producing  or  overhauling  equipment  such  as  a  depot,  have  large  infrastructures 
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dedicated  to  the  support  and  operation  of  that  product  or  service.  Vast  amounts  of  funding  have 
been  allocated  and  invested  in  the  particular  public  entity  to  accomplish  the  mission  assigned  by 
the  overarching  agency.  More  so  than  not,  these  public  facilities,  labor,  and  capital  investments 
are  capable  of  being  allocated  much  more  work.(GAO,  1996)  This  excess  capacity  is  a 
competitive  strength  for  the  public  entity. 

For  example,  prior  to  the  selection  as  winner  of  the  C-5  Overhaul  competition,  Warner 
Robbins  ALC  had  the  facilities  and  manpower  to  overhaul  the  large  C-141  Starlifter  and  smaller 
C-130  Flercules  cargo  aircraft.  Simultaneously,  the  facility  conducted  overhauls  of  smaller, 
technologically  more  complex  F-15  fighter  aircraft  further  demonstrating  the  skill  level  of  its 
workers  and  varied  capabilities  of  the  infrastructure.  However,  the  extensive  facilities  still 
remained  underutilized.  Warner  Robbins  overhead  facilities  included  16  large  work  bays, 
multiple  machine  shops,  paint  de-paint  facilities,  as  well  as,  a  highly  capable,  and  in-place, 
material  supply  center.  ALC  was  able  to  present  this  known  under-utilization  as  a  beneficial 
strength  in  the  competitive  proposal  for  C-5  overhauls.  The  proposal  documented  the  excess 
capacity  as  saving  the  Air  Force  a  total  of  $20.3  million  dollars  in  overhead  savings.  In  addition 
to  the  savings  for  C-5  overhead,  Warner  Robbins  further  advertised  a  decreased  cost  of  other 
government  workloads  by  $162.8  Million  Dollars.  This  large  underutilization  of  public  facilities 
became  a  definitive  competitive  asset,  and  one  of  the  key  reasons  for  contract  award  by  the  Air 
Force.  (Beach,  1997) 

Clearly,  the  fact  that  a  public  organization  can  accept  more  work  in  an  attempt  to  further 
utilize  public  equipment  and  facilities  is  a  powerful  asset.  Every  attempt  must  be  made  by  the 
public  entities  to  investigate,  identify,  and  take  full  advantage  of  inherent  strengths  involving  the 
present  facilities  and  capital  investments  of  a  public  entity. 
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Utilize  Expertise  and  Corporate  Knowledge.  One  of  the  most  important  aspects  of  the 
Organic  factor  is  the  availability  of  expertise  and  corporate  knowledge  about  the  public  entity’s 
business.  No  other  organization,  including  the  private  entities,  will  know  more  about  the 
competitive  workload  than  the  threatened  public  organization  itself.  Corporate  knowledge,  in  the 
context  of  this  study,  is  defined  as  the  experience  base  obtained  through  long-term  contact  and 
performance  within  the  workload  area. 

The  workforce  of  a  public  entity  is,  in  particular,  one  of  the  key  factors  in  the  corporate 
knowledge  issue.  It  is  the  workers  of  a  public  entity  that  carry  out  the  procedures  that  produce 
the  product  or  service.  The  experience  these  individuals  have,  in  regards  to  the  product  or 
service  they  provide,  is  difficult  to  replace  and  demands  to  be  recognized  as  a  potential 
competitive  strength.  For  example,  the  U.S.  Coast  Guard  operates  and  overhauls  a  French 
designed  helicopter,  the  Eurocopter  HH-65A  Dolphin.  The  service  has  been  flying  this 
helicopter  since  1984,  and,  as  a  result,  the  Aircraft  Repair  and  Supply  Center  (AR&SC),  the 
service’s  depot,  has  over  seventeen  years  of  in-depth  knowledge  on  aircraft  particulars  to  include 
overhaul  peculiarities,  expected  parts  replacement,  parts  reverse  engineering,  and  airframe 
performance  issues.  In  fact,  in  1998,  the  depot’s  workforce  built  from  scratch,  using  parts  from  a 
mishap  airframe,  a  brand  new  FIFI-65A  airframe.  This  indigenously  built  airframe  is  now  the  test 
prototype  for  the  HH-65B  Dolphin  avionics  upgrade  program. (AR&SC,  2000)  Because  of  the 
small  number  of  14H-65A  airframes  in  the  U.S.  armed  forces  (all  93  units  in  procession  by  the 
U.S.  Coast  Guard),  the  capabilities  and  experience  of  this  highly  skilled  workforce  is  difficult  to 
duplicate  by  anyone  with  exception  of  the  aircraft’s  original  manufacturer.  This  is  true  of  any 
asset  or  service  that  is  of  interest  only  to  a  small  customer  base.  It  would  be  extremely  difficult 
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for  private  corporations  to  cost  effectively  duplicate  the  amount  of  historical  expertise  already 
available  and  funded  by  the  overarching  agency. (GAO,  1996) 

The  fact  that  public  entities  presently  have  trained  workforces,  and  own  corporate  knowledge 
associated  with  those  workforces,  must  be  addressed  in  competition  preparation.  Although 
sometimes  overlooked,  public  management  must  endeavor  to  identify,  improve,  capitalize  on, 
and  offensively  present  to  the  selection  board  this  readily  available  and  extraordinary  capability. 

Historical  organizational  experience  is  another  aspect  of  this  corporate  knowledge.  Most 
threatened  public  organizations  have  backgrounds  that  can  be  identified  as  strengths  in  a 
competitive  environment.  These  include  past  experiences  with  services,  products,  business 
practices,  and  customers.  In  the  literature,  it  has  been  stated  that  there  are  definitive  differences 
between  the  private  and  public  entity  competitive  capabilities.  A  key  item  that  differentiates 
these  two  is  this  historical  background  in  the  subject  workload  area.  In  the  past,  private  firms 
have  complained  that  the  public  sector  proposal  is  automatically  given  preference  because  its 
historical  experience  is  given  a  weight.  This  takes  place  despite  the  fact  a  public  institution  may 
be  suffering  from  inefficiencies  causing  a  competition  in  the  first  place.  The  private  firms 
constantly  question  the  ability  of  local  public  entities  to  compete  because  they  do  not  operate 
facilities  throughout  the  country  and  possess  a  network  of  national  experts  and  resources.  The 
main  complaint  is  that  competitors  are  not  evaluated  on  a  level  playing  field. (Eggers,  1998) 

The  public  agencies  counter  with  the  fact  that  it  may  not  have  the  varied  and  highly 
competitive  infrastructure  of  the  private  sector,  but  it  does  have  an  historically  in-depth  and 
superior  knowledge  of  the  local  business  environment.(Eggers,  1998)  The  term  environment  is 
used  in  this  context  to  describe  the  entire  scope  of  public  entity  operations;  it  consists  of  all 
inputs  and  outputs  to  the  business  process  in  which  exists  the  public  organization.  (Hammer  and 
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Champy,  2001)  These  inputs  and  outputs  consist  of  such  items  as  unit  transactions,  contracts, 
suppliers,  support  channels,  and  community  relationships.  Once  again,  the  Coast  Guard 
relationship  with  AR&SC  and  the  HH-65A  Dolphin  program  is  a  perfect  example  of  this 
historical  background.  (AR&SC,  2000) 

It  must  be  remembered  that  when  a  public  organization  prepares  to  compete,  these  historical 
processes  inevitably  become  more  streamlined,  cost  effective,  and  cost  efficient.  (Hammer  and 
Champy,  2001)  This  is  important  baseline  for  the  public  entity.  If  the  public  organization  does 
not  provide  a  competitive  service,  the  private  entity  simply  has  no  competition. 

All  of  this  has  held  extremely  true  in  the  awarding  of  contracts  to  Warner  Robbins  ALC,  the 
Louisville  Naval  Armament  Depot,  and  the  Norfolk  NADEP.  Each  of  these  particular  examples 
presents  a  public  entity  competitively  overcoming  extremely  capable  private  bidders;  they  have 
done  this  through  solid  presentations  of  historical  assets  associated  with  expertise  and  corporate 
knowledge.  The  fact  that  this  issue  has  assisted  the  selection  of  public  entities  solidifies  the 
importance  of  capitalizing  on  an  organizations  entire  experience  base. (Stockman,  2001) 

In  addition  to  the  experience  of  an  organization,  the  working  relationship  between  the  public 
entity  and  the  overarching  agency  should  be  presented  as  strength  in  regards  to  corporate 
knowledge  and  expertise.  (Greenough  and  Eggum,  1999)  During  the  C-5  competition,  the  public 
entry,  Warner  Robbins  ALC,  was  able  to  present  itself  as  a  known  Air  Force  commodity;  it  had  a 
successful  business  relationship  with  the  service  prior  to  the  competition.  This  successful  and 
familiar  relationship  clearly  assisted  the  source  selection  team  in  the  arduous  task  of  minimizing 
the  risk  and  maximizing  the  value  to  the  Air  Force.(Beach,  1997)  The  same  thing  can  be  said  in 
reference  to  the  Coast  Guard  and  its’  aviation  depot,  AR&SC.  If  AR&SC  were  to  participate  in 
a  public  private  competition,  the  long,  risk-minimizing  relationship  between  the  depot  and  the 
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Coast  Guard  would  be  a  definitive  competitive  strength.  Past  successes  in  unit  support, 
contracting,  overhaul,  and  contingencies  could  be  capitalized  upon  for  competitive 
differentiation  by  AR&SC  management  teams. 

In-depth  knowledge  of  the  overarching  agency  needs,  and  how  to  satisfy  them,  is  particularly 
difficult  for  private  entities  to  identify,  replicate,  and  convey  in  their  proposal.  This  is  certainly 
due  to  the  level  of  confidence  such  a  relationship  entails  between  the  overarching  agency  and  the 
public  entity.  As  some  of  the  literature  suggests,  this  is  not  conducive  to  a  level  playing  field  in 
competition.(Martin,  1999)  However,  it  is  a  definite  factor  in  selection  teams  evaluating  best 
value  for  the  overarching  agency.  (Stockman,  2001) 

Finally,  the  knowledge  and  expertise  involved  with  key  contractors  must  be  identified  within 
the  organization.  Contractors  are  a  key  aspect  of  a  well-organized,  competitive  public  entity.  As 
players  in  the  public  operation,  they  enable  the  organization  to  be  effective  and  efficient  at  the 
organization’s  core  competencies.  Because  of  this,  the  contractor’s  capability  and  contribution 
to  a  pubic  entity  is  invaluable  and  should  be  completely  documented  as  a  strategic  strength.  A 
good  example  of  this  dramatic  contractor  influence  can  be  seen  in  the  public/private  consortium 
contract  awarded  to  the  Louisville  Naval  Armament  Depot.  At  this  depot,  the  original  equipment 
contractors,  along  with  subcontractors,  were  able  to  highlight  the  successful  key  aspects  of  their 
integration  as  team  members  via  an  unsolicited  proposal  to  the  U.S.  Navy.  Without  this 
contractor  support  and  participation  in  the  proposal,  it  is  very  likely  the  depot  would  have  been 
shut  down  and  the  workload  transferred  to  other  public  military  depots  around  the 
country. (GAO,  1996)  This  level  of  contractor  contribution  is  an  asset.  It  should  be  clearly 
identified  and  fully  utilized  by  the  public  management  team  during  proposal  development. 
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Highlight  Readiness  Capability.  An  interesting  point,  and  one  that  is  often  overlooked  due  to 
its  simplicity,  is  the  fact  that  a  public  entity  is  owned  and  controlled  by  the  overarching  agency. 

A  beneficial  result  of  this  is  the  ability  of  the  overarching  agency  to  impose  its  will,  at  its 
pleasure,  on  that  organization.  When  a  government  turns  over  functions  it  previously  operated  to 
private  companies,  this  control  is  lost  and  public  oversight  of  the  new  provider  becomes 
extremely  important.(Bunker  and  Davis,  2000)  The  overarching  agency  no  longer  has  this  direct 
control;  it  is  limited  by  the  contract  specifications  and  the  private  entity’s  interpretation  of  those 
specifications.(Amavas  and  Ruberry,  1999)  An  interesting  example  of  this  has  little  to  do  with 
the  military.  In  November  of  1997,  two  convicted  sex  offenders  scaled  a  prison  fence  outside  of 
Houston,  Texas,  and  made  it  200  miles,  nearly  to  metropolitan  Dallas,  before  authorities 
apprehended  them.  What  makes  this  case  special  is  that  the  state  of  Texas  could  do  nothing  to 
punish  them  for  escaping;  in  fact,  state  authorities  had  no  idea  the  men  were  serving  time  in 
Texas!  The  escapees,  convicted  in  Oregon,  had  broken  out  of  one  of  Texas’s  thirty-eight 
privately  operated  prisons.  This  example  reflects  the  increased  pressure  and  risk  that  an 
overarching  agency  must  deal  on  the  federal,  state,  and  local  level  to  cut  costs  and  streamline 
operations  through  vehicles  like  public  private  competition.  It  also,  unfortunately,  clearly  points 
out  the  lack  of  control  a  government  inherits  when  awarding  contracts  to  private  competitors. 
(Bunker  and  Davis,  2000) 

What  does  this  have  to  do  with  readiness?  It  is  simple.  Readiness  is  defined  as  the  ability  to 
properly  respond  when  called  upon  with  the  right  equipment  at  the  right  time.  According  to  10 
United  States  Code  2464,  Department  of  Defense  activities  must  maintain  a  core  logistics 
capability,  including  personnel,  equipment,  and  facilities  sufficient  to  provide  the  technical 
competence  and  resources  necessary  for  effective  and  timely  response  to  a  mobilization  or  other 
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defense  emergency.  Basically,  this  code  provides  guidance  to  the  Department  of  Defense  in 
order  to  maintain  control  over  assets  such  as  public  depots.  Although  this  core  workload  has  the 
ability  to  be  waived  by  Congress  in  some  situations,  the  fact  remains  that  the  Department  of 
Defense  clearly  recognizes  outsourcing  entire  workloads  as  a  risk  to  readiness.  (GAO,  1996) 
However,  this  core  capability  is  not  required  in  other  public  organizations.  As  a  result,  the 
outsourcing  risk  becomes  an  unchecked  danger  to  other  public  agencies  and  their  own  readiness 
levels.  An  example  of  a  non-DOD  organization  whose  readiness  could  be  affected  by 
outsourcing  is  the  Federal  Aviation  Administration’s  Air  Route  Traffic  Control  System. 

Without  complete  control  over  the  public  entity,  the  overarching  agency  loses  this  ability  to 
respond  quickly  with  the  greatest  amount  of  flexibility.  For  example,  if  an  organization  were 
forced  to  make  strategic  changes  to  induction  schedules  for  a  private  entity  depot,  there  is  a 
significant  chance  it  would  be  constrained  by  the  contract  terms  limiting  workload  changes. 
Unfortunately,  not  all  contingencies  can  be  thought  of  when  a  contract  is  developed  and  awarded 
to  a  private  entity. (Amavas  and  Ruberry,  1999)  As  recognized  by  the  Department  of  Defense, 
this  lack  of  control  is  the  risk  other  public  organizations  incur  when  contracting  a  private 
organization  for  workloads.  There  is  generally  little  flexibility. 

Flexibility,  on  the  other  hand,  is  the  strength  of  a  vertically  integrated  public  entity  and 
overarching  agency.  Vertical  integration  allows  an  organization  to  provide  higher  levels  of 
control,  as  well  as,  higher  quality  work  in  a  timelier  manner  without  being  constrained  by  outside 
organizational  agendas.  It  takes  full  advantage  of  the  internal  organization’s  human  resources, 
equipment,  and  facility  space.(Krajewsiki  and  Ritzman,  2001)  With  this  vertical  integration, 
any  product  or  procedural  change  can  be  quickly  and  efficiently  implemented  within  the 
overarching  agency.  If  this  total  control  cannot  be  assured,  then  readiness  of  the  overarching 
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agency  may  suffer.  This  points  out  the  competitive  strength  of  a  public  entity  continuing  work 
for  the  overarching  agency. 

Advertise  Reliable  Support  Infrastructure.  One  item  that  has  been  alluded  to,  but  not  yet 
addressed,  is  the  capability  of  a  public  organization  to  present  an  already  operating  and  reliable 
support  infrastructure  for  its  workload. (Beach,  1997)  This  term,  support  infrastructure,  implies 
all  supply  channels,  contractor  relationships,  and  management  information  systems.  It  is  the 
infrastructure  that  allows  the  public  entity  to  effectively  and  efficiently  produce  the  product  or 
service  to  the  overarching  agency.  Again,  it  must  be  remembered  that  this  assumes  the  public 
organization  is  operating  with  no  crucial  inadequacies;  the  organization  is  only  threatened  to  be 
outsourced  due  to  reasons  beyond  business  performance.  A  policy  to  reduce  support  ownership 
costs,  such  as  represented  by  the  Coast  Guard  IDS  program,  could  be  an  example  of  these  other 
reasons. 

Although  applicable  throughout  all  aspects  of  a  public  private  competition.  Best  Value  is  a 
term  that  now  enters  into  the  discussion  of  support  infrastructure.  Best  value  can  be  defined  as 
meeting  all  the  needs  of  a  customer. (Hammer  and  Champy,  2001)  This  includes  items  such  as 
flexibility,  quality,  timeliness,  and  reliability  of  a  support  structure;  it  is  not  just  simply  the 
lowest  cost.  It  is  extremely  possible  that  the  overarching  agency’s  need  for  a  reliable  support 
infrastructure  is  greater  than  the  risk  associated  with  relying  on  an  unfamiliar  support  system 
sponsored  by  a  private  entity. (Dwyer,  2001)  If  a  responsive  and  highly  reliable  support  structure 
is  already  in  place,  then  this  must  be  considered  a  strength  of  the  public  entity.  The  support 
infrastructure  of  a  public  entity  must,  therefore,  be  presented  in  such  a  way  to  highlight  this 
strength. 
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Develop  Performance  Guarantees.  Issues  such  as  cost  information,  politics,  and  overhead 
will  be  included  in  this  competitive  proposal;  these  have  all  been  referenced  heavily  in  the  past 
sections  of  this  chapter.  What  has  not  been  mentioned  is  the  topic  of  performance  guarantees 
and  penalties.  It  is  important  that  public  management  teams  address  this  issue  with  an  open- 
minded  approach.  Although  against  the  quality  improvement  principle  of  doing  a  job  right  the 
first  time,  the  competitive  attribute  here  is  comfort  level  of  the  overarching  agency.(Hammer  and 
Champy,  2001)  If  the  public  management  team  can  provide  a  better  or  more  encompassing 
guarantee,  then  the  public  proposal  is  that  much  more  competitive  than  the  private,  unknown 
entities.  A  known  quantity  such  as  a  public  entity  with  good  performance  guarantees  is  a 
powerful  combination  in  a  managed  competition. 

Legally  binding  performance  guarantees  are  typically  required  of  private  firms  when  they 
enter  into  service  contracts  with  overarching  public  agencies.  In  addition,  private  entities  are 
often  required  to  put  up  a  performance  bond  to  guarantee  performance  over  the  multi-year 
contract.  Public  teams,  on  the  other  hand,  are  usually  not  subject  to  the  same  performance 
requirements;  meaning,  they  are  not  subject  to  financial  penalties  for  cost  overruns.  Private 
entities  argue  that  the  bids  put  in  by  public  teams  would  be  higher  if  they  were  subject  to  the 
same  financial  consequences  as  the  private  sector.(Eggers,  1998) 

The  literature  suggests  that  to  participate  and  be  competitive  in  a  fair  competition,  the  public 
entity  must  be  subject  to  downside  financial  risk  when  they  enter  into  a  contract.  However,  these 
same  guarantees  and  penalties  can  also  be  a  positive  disruptor  of  the  level  competitive  playing 
field;  the  public  entity  can  use  well-developed  warranty  plans  as  a  competitive  asset.  The 
following  are  several  ways  a  public  organization  could  present  guarantees.  First,  a  cost  overrun 
fund  could  be  established  and  withheld  by  the  public  entity;  it  would  be  used  in  case  of  a  true 
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overrun.  The  cost  would  then  be  tacked  on  to  the  price  of  the  budget  or  contract  cost.  Another 
tool,  although  extreme,  would  be  a  proactive  agreement  for  simple  contract  termination  upon  a 
lack  of  performance;  a  re-solicitation  would  take  place  for  the  workload.  Because  of  this 
necessity  to  ensure  a  level  playing  field,  and  the  opportunity  to  further  differentiate  themselves 
from  the  private  entity,  public  management  must  seriously  anticipate  how  it  could  best  integrate 
such  penalties  into  its  competitive  proposal.  (Eggers,  1998)  A  warranty  could  be  the  difference 
between  winning  a  competition  or  losing  the  workload. 

Conduct  of  Proposal  Preparation.  To  compete  within  a  public  private  competition,  the  public 
entity  must  submit  a  proposal  that  is  not  only  compliant  with  the  Request  for  Proposal,  but  also 
highly  credible  and  competitive  with  private  submissions.  From  the  literature,  it  appears  that 
Cost  Factors,  Political  Factors,  and  Organic  Factors  should  all  be  incorporated  into  a  proposal  to 
present  a  complete  picture  of  a  competitive  public  entity.  The  problem  for  public  agencies  lies  in 
the  fact  that  they  do  not  generally  possess  an  experienced  background  in  the  business 
environment  or  with  proposal  development.  Being  a  public  entity,  this  concept  of  competition  is 
not  just  new,  but  completely  foreign.  (Greenough  and  Eggum,  1999)  It  is  one  thing  for  a  public 
organization  to  conduct  process  reengineering  efforts  for  self-improvement  goals,  but  it  is  quite 
another  to  present  all  those  defining  organizational  activities  in  a  manner  conducive  to  winning  a 
competition. 

One  of  the  first  things  which  needs  to  be  addressed  is  the  requirement  to  hire  outside 
assistance  for  proposal  preparation.  Earlier  in  the  Cost  Factor,  it  was  mentioned  that  outside 
consultants  should  be  used  to  assist  with  the  formation  of  the  cost  portion  of  a  proposal. 

Similarly,  there  should  be  consultants  hired  to  assist  with  preparation  of  all  other  aspects  of  a 
competitive  proposal.  Many  governments  around  the  world  have  found  that  hiring  experienced 
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consultants  to  assist  in  proposal  preparation  enhances  competitive  neutrality.  After  all,  the 
public  managers  must  remember  their  competition  is  extremely  proficient  at  this  endeavor. 
Having  conducted  dozens  of  competition  procurements,  many  available  consultants  can  bring 
greater  objectivity  and  credibility  to  those  public  entities  participating  in  the  managed 
competition.  It  is  important  to  note  that  the  costs  of  the  consultants  should  be  included  in  the 
proposal  to  foster  a  level  playing  field,  and  also,  to  offensively  disarm  any  potential  bidder 
protests. (Eggers,  1998) 

Attending  Pre -Proposal  Conferences  can  be  a  proactive  action  done  to  ensure  a  public 
management  team  has  complete  understanding  of  the  RFP.  The  purpose  of  such  conferences  is 
to  brief  prospective  offerors  to  make  certain  they  understand  the  RFP’ s  requirements  and  to  give 
them  an  opportunity  to  obtain  clarifications  and  explanations.  If  a  pre-proposal  conference  is 
held,  it  is  extremely  prudent,  although  not  mandatory,  for  all  prospective  competitors  to  attend. 
These  conferences  are  usually  conducted  by  the  Contracting  Officers  or  his 
representative. (Amavas  and  Ruberry,  1999)  It  is  in  the  best  interest  of  a  public  management 
team  to  attend  a  pre-proposal  conference  to  obtain  the  aggregate  data  and  tools  necessary  for 
further  bridging  a  very  credible  experience  gap. 

Although  extremely  important,  proposal  preparation  should  not  be  a  monumental  task  for  the 
public  entity.  With  the  help  of  consultants  and  motivated  personnel,  it  should  be  an  exercise  in 
capturing  readily  available  information  and  presenting  it  in  the  proper  format  for  competitive 
evaluation.  A  proposal  is  simply  a  snapshot  of  an  already  competitive  public  organization. 


51 


The  following  figure  contains  a  quick  reference  review  of  Key  Issues  under  the  Organic 


Factor. 


ORGANIC  FACTOR 

Highlight  Overhead  and  Excess  Capacity 

-Underutilized  Public  Facilities 
-Underutilized  Skilled  Workforce 
-Underutilized  Public  Capital 

Utilize  Expertise  and  Corporate  Knowledge 

-Workforce  Knowledge  Base 
-Historical  Experience  Base 

-Working  Relationship  Between  Public  Entity  and  Overarching  Agency 
-Contractor  Experience 

Highlight  Readiness  Capability 

-Level  of  Control  of  Workload 

-Readiness  Risk  vs.  Outsourcing  Entire  Workloads 

-Issue  of  Flexibility  and  Vertical  Integration  Benefits 

Advertise  Reliable  Support  Infrastructure 

-Capitalize  on  proven  and  reliable  infrastructure 
-Best  Value  and  the  Support  System  in  Competition 
-Infrastructure  as  a  Competitive  Strength 

Develop  Performance  Guarantees 

-Comfort  level  of  Overarching  Agency  as  Important  Attribute 
-Beneficial  types  of  Public  Guarantees  and  Penalties 
-Guarantees  required  for  Level  Playing  Field 

-Guarantees  and  Penalties  as  positive  disruptor  in  a  Level  Playing  Field 

Conduct  of  Proposal  Preparation 

-Lack  Public  Management  Team  Experience  and  Knowledge  in  Subject  Area 
-Outside  Assistance  Required  to  Prepare  Proposal 
-Utilization  of  Pre-proposal  Conferences 

-Inclusion  of  Cost  Factor,  Organic  Factor,  and  Politics  Factors  in  Proposal 


Figure  7.  Key  Factors  and  Sub  Factors  of  Organic 
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III.  Methodology 


Introduction 

The  goals  of  this  study  are  to  accomplish  two  objectives.  The  first  is  to  identify  the  factors 
important  for  a  public  entity  to  be  competitive  in  a  public  private  competition.  The  second  is  to 
establish  the  overall  position  of  the  U.S.  Coast  Guard  Aircraft  Repair  and  Supply  Center 
(AR&SC)  in  addressing  these  key  factors  to  be  competitive  in  a  managed  competition.  Once 
again,  it  is  hoped  the  results  of  this  research  will  assist  AR&SC  in  preparation  of  a  competitive, 
defensive  strategy  against  outsourcing,  as  well  as,  increase  the  depot  efficiencies  in  direct 
support  of  the  Coast  Guard  IDS  philosophy  of  minimizing  ownership  costs. 

The  methodology  of  this  study  will  be  divided  into  two  phases  with  each  addressing  a 
particular  thesis  objective.  In  addressing  the  first  goal,  the  research  model  presented  in  chapter 
two,  Figure  1,  will  be  validated  using  the  Delphi  Technique  of  expert  solicitation  and  consensus. 
Upon  completion  of  the  model  validation,  the  AR&SC  leadership  and  business  management  will 
be  surveyed  in  regards  to  the  validated  key  competitive  factors  to  measure  the  depot’s  present 
capability  to  meet  them.  At  a  minimum,  what  is  being  sought  is  a  baseline  of  AR&SC’s 
competitive  capability.  Flowever,  it  is  hoped  that  an  assessment  tool  can  be  developed  from  this 
study  that  will  allow  AR&SC  to  quickly  measure  its  position  in  regards  to  preparedness  for  a 
public  private  competition. 

Delphi  Technique 

The  Delphi  Technique  is  a  method  of  eliciting  and  refining  group  judgments.  Simply  put,  it  is 
a  multistage  process  involving  the  initial  measurement  of  opinions,  followed  by  data  anaylsis, 
design  of  a  new  questionnaire  base  on  group  responses  to  the  previous  questions,  and  a  second 
measurement  of  opinions.  This  is  followed  by  additional  questionnaires,  designed  in  the  similar 
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fashion,  repeated  until  consensus  is  reached  or  a  saturation  of  opinion  occurs.  A  key  aspect  of 
this  technique,  experts  are  used  to  participate  in  developing  and  responding  to  issue  items 
included  in  the  survey.  Another  important  factor  is  that  it  allows  these  expert  participants  to 
reconsider  their  opinions  in  light  of  the  views  of  other  stakeholders.  (Rayens  and  Hahn,  2000) 

The  rationale  behind  the  technique  is  quite  simply  “two  heads  are  better  than  one”;  this  is 
particularly  valid  when  the  subject  issue  is  one  where  the  exact  knowledge  is  not  available  or 
readily  known  (Dailkey,  1968:6).  This  is  the  situation  with  which  this  study  finds  itself.  The 
key  competitive  factors  for  a  public  entity  have  been  researched  from  current  literature,  yet  the 
model  developed  from  this  research  requires  validation  by  another  source.  This  source  is  a  group 
of  highly  experienced  professionals  in  the  field  of  public  private  competition;  for  this  study,  they 
will  be  referred  to  as  experts. 

There  are  three  key  features  of  the  Delphi  Technique  that  must  be  mentioned  because  they 
clearly  point  out  the  basis  of  this  procedure.  The  first  is  the  anonymous  response  in  which  group 
opinions  are  obtained  by  a  questionnaire  without  the  members  knowing  who  else  is  participating. 
This  is  done  to  avoid,  what  numerous  studies  have  identified  as  serious  difficulties  with  face-to- 
face  group  interaction.  These  difficulties  include  the  influence  of  dominant  individuals  on  group 
opinion,  the  semantic  noise  where  everything  else  is  discussed  but  the  actual  problem,  and 
finally,  the  group  pressure  for  conformity  leading  to  distortions  of  individual  judgment. (Dailkey, 
1968) 

The  second  is  iteration  and  feedback  of  information.  The  interaction  of  the  group  member  is 
effected  by  a  systematic  exercise  conducted  by  utilizing  several  iterations  of  surveys  integrating 
a  controlled  feedback  tool.  This  is  important  because  it  provides  the  member  with  input  from 
previous  rounds  of  the  questionnaire,  not  only  from  himself,  but  from  the  group  of  experts.  This 
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feedback  can  be  a  highly  motivating  environment  for  respondents.  Having  experts  share 
information  in  this  manner  can  be  academically  refreshing,  beneficial,  and  interesting  to  all. 
Additionally,  the  use  of  a  systematic  procedure  allows  the  respondents  to  have  a  sense  of 
objectivity  in  the  study.(Dailkey,  1968)  It  is  not  often  that  participants  can  release  their 
inhibitions  on  topics  to  an  expert  community.  The  Delphi  Technique  allows  this  to  take  place. 

Finally,  group  agreement  on  a  subject  is  defined  as  an  aggregate  opinion  during  the  final 
round.  Group  Opinion  is  expressed  in  terms  of  a  statistical  score.  This  is  called  consensus  of  the 
factor,  and  this  is  the  overall  goal  of  the  Delphi  Technique. 

Opinion,  Speculation,  and  Knowledge  -  The  Delphi  Technique  seeks  to  capture  a  particular 
piece  of  the  decision  input  spectrum  provided  by  expert  participants.  There  are  roughly  three 
types  of  decisions  that  a  participant  can  make  in  response  to  questions  on  a  survey.  They  can 
provide  direct  answers  with  facts  or  knowledge,  they  can  provide  their  judgment  or  opinion  of 
the  topic,  or  they  can  purely  speculate  about  the  topic. 

Knowledge  feedback  will  undoubtedly  have  large  amounts  of  evidence  backing  it  up  as  fact. 

It  will  be  the  information  most  likely  found  in  many  reference  books  on  any  particular  topic;  it  is 
the  baseline  for  fact.  At  the  other  end  of  the  scale  is  speculation.  This  is  where  the  member 
provides  information  with  very  little  or  no  evidence  at  all  to  provide  reference  for  the  statement. 
In  other  words,  it  is  a  pure  guess  or  educated  feeling  provided  by  the  respondent  without  any 
information  to  back  up  the  statement.  Finally,  in  between  the  two  points  of  fact  and  speculation, 
there  lies  the  feedback  called  opinion. 

Opinion  is  the  broad  area  of  material  for  which  there  is  some  belief  or  evidence  behind  the 
statements,  but  not  sufficiently  enough  to  confirm  the  statement  as  knowledge.  Figure  8 
provides  a  graphical  presentation  of  these  three  areas  of  decision-making  and  probabilities 
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associated  with  factual  truth.  It  is  important  to  point  out  that  what  separates  knowledge  from 
opinion  is  the  fact  that  there  is  a  reasonable  probability  that  opinion,  when  expressed,  may  be 
false.  However,  this  does  not  stop  the  use  of  opinion  to  further  validate  the  inclusion  or 
exclusion  of  knowledge  points  in  a  theory  or  research  model.  It  simply  states  that  there  are 
different  levels  of  decision-making  information. (Dailkey,  1968) 


Spectrum  of  Inputs 


Figure  8.  Probability  Scale  of  Opinion  vs.  Knowledge  (Dailkey,  1968:3) 


The  Delphi  Technique  seeks  to  explore  this  area  of  opinion  to  obtain  access  to  the  less  factual, 
yet  extremely  valuable  products  of  judgment,  wisdom,  and  insight  of  subject  experts.  This 
opinion  is  only  readily  accessible  by  means  such  as  direct  expert  contact  though  interviews, 
questionnaires  or  surveys.  The  value  that  expert  opinion  has  to  the  researcher  lies  in  the 
capability  the  information  has  to  validate  knowledge  points  brought  out  from  literary  research 
and  model  developments.  As  a  result,  this  study  will  utilize  several  iterations  of  a  survey  to 
isolate  this  opinion  base.  It  is  hoped  that  the  Delphi  Technique  can  be  used  to  confirm  the 
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model’s  knowledge  based  structure,  therefore  providing  the  researcher  with  a  refined  model  to 
measure  AR&SC. 

More  opinions  are  better  than  one  -  As  stated,  it  has  been  said  that  two  heads  are  better  than 
one.  Literature  suggests  that  it  is  better  to  take  the  opinions  of  many  experts  and  aggregate  them 
because  the  range  of  answers  is  likely  to  include  the  true  answer  to  a  question.  Figure  9  shows 
the  dependence  on  group  size  of  the  mean  accuracy  of  a  response  for  a  large  set  of 
experimentally  derived,  known  answers  to  factual  questions.  In  other  words,  the  experimenters 
knew  the  true  answers  to  the  questions,  and  the  subject  experts  did  not.  The  main  point  is  that  as 
the  group  gets  larger,  so  does  the  accuracy  of  the  consensus  answer 

The  Figure  8  curve  was  derived  by  computing  the  average  error  of  various  sized  groups;  the 
individuals  answers  were  drawn  from  the  experimental  distribution.  It  is  clear  from  Figure  8  that 
with  this  population  of  answers,  the  gains  in  increasing  group  size  appears  large.  Notice  that  the 
largest  group  tested  was  29;  please  note  that  the  curve  appears  to  be  in  a  decreasing  trend  as  the 
groups  size  increases.  The  larger  the  group,  the  lower  the  error  in  reaching  the  true 
statement. (Dailkey,  1968)  It  should  also  be  pointed  out  that  as  the  complexity  of  the  issue 
increases,  the  sample  size  needs  to  be  larger  to  include  the  entire  range  of  participant  experts;  an 
example  would  be  inclusion  of  experts  both  for  and  against  a  policy  issue.  This  increases  the 
value  of  the  expert  group  to  the  studies  results.(Rayens  and  Hahn,  2000)  For  this  study,  every 
effort  was  made  to  recruit  the  largest  and  most  varied  group  of  experts  attainable  in  the  field  of 
Source  Selection  and  public  private  competition  experience. 
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Figure  9.  Effect  of  Group  Size  on  Response  Error  (Dailkey,  1968:11) 


Reliability-  Another  important  consideration  of  using  experts  to  gain  consensus  is  the  issue  of 
reliability.  It  is  clearly  desirable  for  a  study  that  another  analyst  using  the  same  approach  and 
different  experts  arrive  at  similar  results.  Once  again,  the  data  from  the  above  experiment 
suggests  that  a  relationship  between  reliability  and  group  size  for  the  experimental  population  of 
answers  does,  in  fact  exist.  This  data  set  in  Figure  10  was  constructed  by  selecting,  at  random, 
pairs  of  respondent,  various  sized  groups  and  correlating  the  median  responses  of  the  pairs  of  20 
test  questions.  The  ordinate  is  the  average  of  these  correlations.  From  this  correlation  displayed 
in  Figure  10,  it  is  clear  that  there  is  a  definite  increase  in  the  reliability  of  the  group  response 
with  increasing  group  size. (Dailkey,  1968) 
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Reliability  vs.  Group  Size 
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Figure  10.  Reliability  vs.  Group  Size  (Dailkey,  1968:13) 

It  can,  therefore,  be  assumed  that  taking  opinions  from  a  group  of  experts,  using  the  Delphi 
Technique,  is  justified  due  to  the  considerations  of  improved  mean  accuracy  and  the  higher 
reliability  of  obtaining  the  actual  true  answer. 

The  Expert  Group 

Selection  of  Organizations.  As  stated  above,  the  one  of  the  goals  in  using  the  Delphi 
Technique  is  to  obtain  a  broad  opinion  slice  of  the  source  selection  and  public  private 
competition  professional  community.  Research  was  conducted  via  literary  searches,  internet 
searches,  and  finally,  email  and  phone  interviews  with  offices  representing  various  centers  of 
topic  knowledge  such  as  Public  Policy  Think  tanks.  Primary  selection  rule  was  the  level  of 
understanding  and  involvement  each  organization  had  with  past  or  present  public  private 
competitions.  A  secondary  selection  criterion  was  the  level  of  compatibility  with  the  U.S.  Coast 
Guard,  its  organization,  and  mission.  The  following  is  a  list  of  the  organization  represented  in 
this  study. 


2  4  6  8  10  12 

Number  in  Group 
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Federal  Aviation  Administration  (FA  A )  -  This  organization  was  chosen  because  of  the 
extraordinary  budgets  dedicated  toward  the  Air  Traffic  Control  Modernization  Program. 
Of  the  federal  government  agencies  dealing  with  outsourcing  and  conducting  public 
private  competitions,  the  FAA  has  been  found  to  be  an  agency  deeply  involved  with  this 
effort.  Presently,  Lockheed,  Boeing,  and  Raytheon  have  all  submitted  proposals  to 
outsource  or  privatize  some  or  all  of  the  nations  Air  Traffic  Control  System.  Because  of 
the  ongoing  efforts  inside  the  FAA,  in  particular  with  the  politics  associated  with  these 
proposals  vice  keeping  the  service  in  house,  this  organization  was  selected  to  participate 
in  the  study. 

A  major  University  -This  University  was  selected  because  it  represented  a  professional 
civilian  academic  entity.  It  is  the  employer  of  one  of  the  nation’s  top  experts  in  the  field 
of  managed  competition.  This  civilian  expert  is  involved  in  the  survey  effort. 

United  States  Air  Force  -  The  United  States  Air  Force  was  selected  because  of  its 
similarity  to  the  United  States  Coast  Guard  in  organization  and  mission  .  Both  services 
operate  military  aircraft,  and  both  services  operate  government  depots  to  maintain  those 
airframes.  In  particular,  and  most  important,  the  Air  Force  was  selected  because  of  its 
broad  experience  with  high  profile,  large  scale  source  selections,  as  well  as,  the 
successful  conduct  of  aviation  depot  public  private  competitions. 

United  States  Coast  Guard  -  The  United  States  Coast  Guard  was  selected  due  to  it  is 
representation  as  a  smaller  government  agency.  The  fact  that  an  entity  inside  the  Coast 
Guard  was  sponsoring  this  study  was  not  relevant;  the  Coast  Guard  was  simply  another 
avenue  to  obtain  data.  Flaving  conducted  smaller  source  selections  and  public  private 
competitions  in  the  past  (A-76  studies),  the  service  was  found  to  have  a  broad  knowledge 
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base  and  experience  level  representative  of  a  budget  challenged  agency  of  the  federal 
government.  The  fact  that  those  answering  the  survey  would  be  part  of  a  potential  source 
selection  team  for  AR&SC  was  a  relevant  factor  however. 

Civilian  Think  Tank  Corporation  -  This  organization  is  represented  in  the  study  by  one  of 
its  key  consultants.  Based  in  Washington  DC,  this  corporation  is  contracted  to  provide 
expert  level  acquisition  support  to  senior  level  acquisition  decision  makers  in  the 
Department  of  Defense.  Its  corporate  image  is  of  a  Center  of  Acquisition  Excellence. 

As  one  can  see,  those  organizations  listed  represent  a  slice  of  the  public  private  competition 
professional  community.  Federal  Agencies  and  Civilian  Institutions  are  both  represented  to 
obtain  an  all  encompassing  input  of  the  managed  competition  issue. 

Expert  Selection.  The  experts  sought  for  this  study  were  high-level  executives  in  each 
representative  organization.  With  the  exception  of  the  expert  from  the  Major  University,  all 
experts  were  each  recommended  by  their  particular  organization.  The  expert  from  the  Major 
University  was  approached  directly  by  the  researcher  of  this  thesis;  in  particular,  he  was  selected 
due  to  his  extensive  research  published  on  the  topic  of  managed  competitions.  Although  not  all 
experts  that  were  approached  agreed  to  participate,  those  that  did  agree  stated  that  they  were 
extremely  motivated  to  participate.  Table  1.  documents  each  participant  and  their  participation 
in  each  survey  round. 
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Table  1.  Expert  Participants 


Expert 

hebusshis 

Position 

D 

0 

□ 

1 

FAA 

Acquisition  Specialist 

B 

2 

Full  Professor 

B 

3 

U.S.  Air  Force 

Financial  Management  Specialist 

B 

B 

a 

4 

U.S.  Air  Force 

Director  Contracting  of  a  Systems  Center 

B 

B 

a 

5 

U.S.  Coast  Guard 

Contracting  Office  Chief 

B 

B 

a 

6 

Civilian  Think  Tank 

An  Acquisition  Policy  Director 

B 

B 

a 

7 

U.S.  Air  Force 

Deputy  Commander  AF  Support  Group 

B 

B 

a 

8 

U.S.  Coast  Guard 

Competitive  Sourcing  Specialist 

B 

B 

a 

9 

U.S.  Coast  Guard 

Commander  of  a  Maintenance  &  Logistics  Center 

B 

B 

a 

As  can  be  seen  from  Table  1,  each  expert  was  given  a  number.  This  kept  the  responses 
anonymous.  Please  note  the  variety  of  positions  each  holds  in  his  or  her  organization;  this 
provides  the  study  with  a  large  cross  section  of  the  public  private  competition  professional 
community.  Once  again,  all  of  the  expert  participants  are  members  of  the  executive  corps  of 
their  respective  organization.  Of  the  nine  survey  participants,  four  are  Senior  Executive  Service 
(SES)  of  Federal  agencies,  one  is  a  military  GS-14,  two  are  military  0-5s,  one  is  a  civilian 
executive  vice  president  in  private  industry,  and  finally,  one  is  a  full  university  professor  and 
associate  department  chair. 

Development  of  the  Delphi  Survey  Instrument 

The  Delphi  instruments  developed  are  questionnaires  specifically  designed  to  reflect  and 
validate  the  results  of  the  research  model  development.  The  goals  of  this  survey  program  are 
three  fold.  The  first  is  to  validate  the  research  model  for  concept  accuracy;  second  is  to  examine 
areas  were  it  is  not  accurate  and  produce  explanations  why.  Finally,  third,  it  is  hoped  that  the 
results  of  this  questionnaire  program  will  produce  a  refined,  highly  accurate  reflection  of  the 
areas  a  public  entity  needs  to  dedicate  resources  to  be  competitive  in  a  public  private 
competition. 
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Each  questionnaire  is  divided  up  into  the  three  key  factors  reflected  in  the  research  model. 
Once  again  those  are  Political,  Cost,  and  Organic.  Under  each  key  factor  heading,  the  questions 
are  further  broken  down  into  sub  groups  reflecting  the  sub  factor  areas.  Together,  each  of  these 
sub  factors  make  up  the  pillars  on  which  each  major  key  factor  is  built. 

The  questions  in  each  survey  are  divided  into  two  types:  closed  and  open.  Most  of  the 
closed  ended  questions  can  be  traced  directly  to  the  literary  research  conducted  to  form  the 
research  model,  however,  as  the  survey  iterations  develop,  several  of  those  closed  questions  are 
also  created  from  expert  comments  in  the  previous  survey.  These  closed  ended  questions 
generally  form  the  core  of  the  survey  tool.  Although  called  closed  ended,  this  set  of  questions 
does  have  an  area  for  participant  comments.  This  provides  an  avenue  to  capture  information 
possibly  not  reflected  or  asked  about  in  the  particular  question  area. 

The  survey  instruments  also  seek  to  query  the  expert’s  knowledge  via  open-ended  questions; 
these  are  positioned  at  the  end  of  each  sub  factor  block.  This  serves  to  capture  any  additional 
thoughts,  concepts,  or  factors  the  expert  believes  should  be  integrated  into  the  study  to  make  it 
more  accurate  and  reflective  of  the  public  private  competition  concept.  Although  this  assists 
with  all  goals,  in  particular,  it  assists  with  meeting  the  third. 

A  five  point  Likert  scale  is  used  in  the  survey  structure.  It  reflects  a  scale  of  agreement  using 
the  descriptions  Disagree,  Moderately  Disagree,  Neutral,  Moderately  Agree,  and  Agree. 

Round  One  Survey.  This  first  questionnaire  formed  the  baseline  of  data  gathering  for  this 
study.  This  can  be  seen  in  Appendix  A.  It  was  the  first  instrument  to  probe  the  expert 
knowledge  base.  It  also  validated  the  instrument’s  design  and  user  flow.  The  closed  questions, 
reflective  of  the  research  model,  helped  to  quantitatively  justify  the  model’s  existence,  while  the 
open-ended  questions  guided  the  development  of  new  questions  for  the  following  second  round. 
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Round  One  Results  and  Second  Survey  Development.  This  second  questionnaire  was 
developed  from  the  responses  produced  from  the  first  instrument.  This  questionnaire  was 
exactly  the  same  as  the  first  one,  but  it  had  some  key  exceptions.  The  first  exception  was  the 
inclusion  of  new  questions  suggested  by  the  experts,  and  the  second  was  the  removal  of  several 
unpopular  and  off  target  questions.  These  off  target  questions  were  identified  as  having  a 
particularly  low  score. 

Determining  which  questions  had  the  lowest  score  was  done  by  taking  the  average  of  the 
answers  for  each  question  and  comparing  it  to  the  threshold  score.  The  threshold  was  established 
at  3.0.  While  this  seems  arbitrary,  a  3.0  score  has  been  utilized  in  past  Delphi  studies  to  establish 
concept  importance.  If  the  question’s  average  was  not  3.0  or  better,  then  the  question  topic  was 
considered  not  important  for  the  study.  (Scheffler  and  Logan,  1999)  The  intent  of  this  study  was 
to  have  minimum  loss  rate  of  questions;  this  minimum  loss  would  reflect  validation  of  the 
research  model.  As  will  be  seen  in  Chapter  IV,  only  two  questions  were  actually  dropped  from 
the  study  during  preparation  for  the  second  survey. 

In  addition  to  adding  new  questions  and  deleting  others,  the  groups  average  for  each  question 
and  the  individual  expert  responses,  were  included  in  the  survey  alongside  the  particular 
question.  Once  again,  this  allowed  the  expert  to  reflect  on  the  previous  individual  and  group 
score  prior  to  answering  the  questions  again. 

Round  Two  Survey.  In  the  second  round,  each  participant  was  provided  an  individually 
prepared  survey  that  reflected  the  individual  and  group  statistics.  This  can  be  seen  in  Appendix 
B.  Additionally,  for  some  of  the  individual  statistics  per  question,  there  was  an  asterisk  included 
next  to  the  response.  This  indicated  those  questions  where  the  individual  response  was  greater 
than  1.25  standard  deviations  of  the  group  mean  for  that  particular  question.  In  the  directions 
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provided  with  the  survey,  it  was  requested  those  experts  provide  comments  on  why  they  think 
their  responses  were  outside  this  statistical  interval.  It  was  hoped  that  this  additional 
information  would  assist  in  determining  if  the  answer  was  based  on  new  information  that  could 
make  the  study  stronger,  or  if  it  was  simply  an  issue  isolated  to  the  particular  organization 
represented  by  the  expert. 

The  results  of  this  second  survey  consisted  of  closed  question  quantitative  data  ,  comments 
from  the  individual  closed  questions,  and  factor  oriented  responses  from  the  open  ended 
questions.  All  of  these  response  types  were  included  in  the  development  of  the  third 
questionnaire. 

Round  Three  Survey.  The  third  questionnaire  was  developed  to  be  the  final  measure  of 
consensus.  This  can  be  seen  in  Appendix  C.  Literature  suggests  that  any  additional  consensus 
obtained  from  more  than  three  iterations  will  be  negligible.  In  other  words,  three  appropriately 
conducted  Delphi  survey  iterations  will  provide  the  best  indication  of  group  agreement  on  a 
topic.  With  any  more  rounds,  the  study  will  begin  to  suffer  from  the  law  of  diminishing  returns. 
(Dickson  and  Leitheiser,  1984) 

This  leads  to  the  question  of  what  constitutes  or  defines  a  consensus.  How  will  this  study 
know  if  agreement  is  quantitatively  reached  after  three  rounds?  For  this  study,  consensus  was 
determined  by  measuring  the  standard  deviations  of  individual  question  responses.  A  deceasing 
standard  deviation  indicates  a  decrease  in  the  differences  between  the  expert  participants  on  a 
particular  question.  As  the  study  moves  from  the  first  to  the  final  round,  the  standard  deviations 
of  these  questions  will  be  plotted  to  indicate  a  trend  toward  a  standard  deviation  of  zero,  or 
perfect  consensus.  (Dickson  and  Leitheiser,  1984) 
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Testing  of  the  Survey  Instrument 

A  pilot  test  was  conducted  utilizing  an  Air  Force  Institute  of  Technology  professor 
knowledgeable  on  the  topic  of  public  private  competitions.  There  were  two  goals  of  this  test. 

The  first  was  to  ensure  the  instrument  flowed  well  and  was  mechanically  sound  for  the  user.  The 
second  was  to  check  for  question  readability  and  user  understanding  of  question  content.  Upon 
completion  of  the  pilot  test,  it  was  found  that  all  of  the  goals  were  met  with  the  exception  of 
readability.  There  were  a  few  questions  that  required  a  revision  for  readability. 

Upon  completion  of  the  pilot  test  revisions,  the  survey  was  then  sent  to  an  additional  Air 
Force  Institute  of  Technology  professor  specializing  in  the  survey  methodology.  This  review 
constituted  a  second  review  of  the  instrument.  The  feedback  from  this  review  identified  a  few 
readability  and  concept  problems;  these  were  quickly  resolved  and  the  results  integrated  into  the 
instrument.  Upon  completion  of  these  minor  changes,  the  survey  was  ready  for  deployment  to 
the  expert  participants. 

Distribution  of  the  Survey  Instrument 

Three  months  prior  to  the  first  survey  round,  the  expert  participants  were  contacted  by 
telephone.  Each  expert  was  interv  iewed  to  find  out  their  background  and  to  evaluate  their 
potential  for  providing  data  on  the  subject  of  public  private  competitions.  A  resulting  benefit  of 
those  interviews  was  the  unilateral  agreement  amongst  all  participants  to  use  electronic  mail 
(email)  for  communication  of  minor  messages  in  reference  to  the  study.  Because  email  proved 
to  be  very  timely  with  each  participant,  and  because  the  experts  all  agreed  to  it,  the  decision  was 
made  to  deliver  the  survey  by  using  the  electronic  mail  system. 

For  every  round,  a  copy  of  the  Survey  and  a  Survey  Introduction  Letter  was  set  as  an  email 
attachment  to  each  participant.  The  Survey  Introduction  Letter  simply  provided  detailed 
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information  on  the  study  and  survey  instructions.  These  can  be  seen  as  Appendix  A,  B,  and  C 
respectively. 

During  the  first  survey  round,  the  experts  were  provided  the  option  of  returning  the  completed 
survey  as  an  email  attachment  or  in  the  regular  mail.  After  all  the  first  round  responses  were 
returned  via  email,  the  decision  was  made  to  discard  the  mail  service  as  a  return  option.  All 
experts  liked  the  idea  of  returning  the  survey  as  an  email  attachment. 

Data  Processing 

Data  processing  was  performed  using  spreadsheets  developed  in  Microsoft  Excel. 

Immediately  upon  receiving  a  survey,  the  results  were  entered  into  the  spreadsheets  utilizing  two 
individuals.  One  would  call  the  data  out,  the  other  would  enter  the  data  into  the  spreadsheet.  As 
a  check  upon  completion  of  data  entry,  the  inputted  data  was  then  read  off  and  verified  with  the 
originating  survey.  This  was  done  individually  for  each  survey  to  minimize  mistakes  in  the 
mechanical  process. 

The  main  area  of  emphasis  in  the  spreadsheets  was  the  computation  of  question  means, 
medians,  and  standard  deviations.  As  will  be  seen  in  the  next  chapter,  this  structure  provided 
absolutely  adequate  datum  from  which  to  verify  the  research  model  and  build  an  evaluation  tool 
for  AR&SC. 

Public  Private  Competition  Assessment  Tool  (PCAT) 

The  next  step  in  the  study  is  the  development  of  a  Public  Private  Competition  Assessment 
Tool,  or  PCAT,  designed  specifically  for  use  by  the  U.S.  Coast  Guard  Aircraft  Repair  and 
Supply  Center. 

With  the  advent  of  the  Integrated  Deepwater  System  (IDS)  Acquisition  plan,  the  threat  of 
outsourcing  historically  Coast  Guard  specific  workloads  to  private  companies  is  very  significant. 
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Of  these  workloads,  one  of  the  most  targeted  is  aircraft  depot  support  and  repair;  this  is  the 
specialty  of  AR&SC.  Because  of  this  issue,  it  was  a  goal  of  this  study  to  develop  an  evaluation 
tool  that  could  assist  AR&SC  management  in  preparing  the  organization  for  a  public  private 
competition. 

Typical  of  most  government  agencies,  AR&SC  has  little  experience  in  the  competitive 
business  arena,  and  as  a  result,  has  little  idea  on  how  a  public  private  competition  works.  With 
the  IDS  program  on  the  horizon,  extinction  is  a  definitive  reality  for  AR&SC  unless  it  can 
recognize  what  it  needs  to  do  to  prepare  for  competition.  This  recognition  not  only  includes 
planning,  but  a  well-designed  distribution  of  resources. 

AR&SC  has  a  unique  position  in  the  Coast  Guard  and  Coast  Guard  Naval  Aviation.  Being 
the  only  government  depot  for  Coast  Guard  aircraft  and  helicopters,  AR&SC  maintains  many 
unique  capabilities  and  conducts  each  of  them  with  extreme  professionalism.  Recent  efforts  to 
further  improve  these  products  and  services  include  Business  Process  Reengineering  (BPR)  and 
the  implementation  of  an  Activity  Based  Cost  System  (ABC).  Both  of  these  efforts  have 
produced  a  very  streamlined  and,  potentially,  cost  effective  organization  sitting  on  the  proverbial 
fence  post  of  competitiveness.  However,  these  accomplishments  will  mean  nothing  unless 
AR&SC  can  effectively  build  on  their  foundations  and  present  them  in  a  competitive  format. 
This  is  where  the  PCAT  enters  into  this  study 

The  PCAT  provides  real  time  feedback  to  the  AR&SC  management  team.  The  foundation  of 
the  tool  is  based  on  three  key  factors  that  make  a  public  entity  competitive.  These  factors  were 
presented  by  this  study’s  research  model  and  verified  through  the  Delphi  process.  Once  gain, 
these  factors  are  Politics,  Cost,  and  Organic. 
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The  basic  premise  of  the  PCAT  is  to  increase  the  visibility  of  these  key  factors  and  how 
AR&SC  management  addresses  them.  AR&SC  management  will  take  this  PCAT  data  and  use  it 
as  a  planning  reference  for  competition  against  private  industry.  The  objective  here  is  to 
provide  the  management  teams  with  broad,  strategic  oriented  recommendations.  The  goal  is  not 
to  micromanage  Coast  Guard  leaders  by  having  the  tool  provide  exact  issue  and  resource 
management  planning;  this  type  of  micro  planning  not  only  decreases  flexibility,  but  it  would 
make  a  tool  far  too  complex  to  be  practicable  for  use.  AR&SC  will  simply  be  provided  just 
enough  key  information  to  make  its  own  decisions  on  resource  deployment  and  factor  priorities. 

Development  of  the  PCAT 

The  PCAT  was  developed  from  the  results  of  the  Delphi  process.  This  survey  procedure 
provided  a  validation  of  the  three  key  factors  of  Politics,  Cost,  and  Organic.  As  a  result,  the 
PCAT’s  evaluation  questions  came  from  the  cadre  of  information  gathered  and  verified  during 
the  first  half  of  this  study.  As  mentioned  earlier,  there  were  only  two  rules  of  the  road  for  this 
tool  development;  they  were  ease  of  use,  and  strategic  level  feedback.  Both  of  these  goals  were 
kept  in  mind  throughout  the  entire  process  of  research,  design,  and  final  production  of  the  PCAT. 

Tool  Design  Research.  After  the  successful  completion  of  the  Delphi  process,  the  next  step 
was  to  develop  a  design  which  could  provide  AR&SC  with  a  worthwhile  assessment  tool.  After 
researching  various  tool  designs  in  use  in  management  today,  it  was  discovered  that  there  was  no 
totally  compatible  design  that  met  the  goals  set  for  AR&SC.  As  a  result,  it  was  decided  to 
benchmark  from  an  already  established  project  management  tool  to  begin  development  of  a  tool 
indigenous  to  AR&SC  needs. 

Called  the  Project  Implementation  Profile,  the  goal  of  this  tool  is  to  assess  how  an 
organization’s  project  was  progressing.  (Pinto  and  Slevin,  1992)  It  was  specifically  developed  to 
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make  periodic  assessments  of  key  factors  concerning  a  project  through  the  implementation 
process.  Attractive  was  its  simplistic  ability  to  conduct  an  evaluation  of  key  factors,  as  well  as, 
its  goal  of  providing  an  iterative  tool  for  the  user.  The  tool  used  a  format  that  broke  down 
project  areas  and  asked  the  user  specific  questions  designed  to  obtain  a  level  of  issue 
measurement.  The  input  obtained  from  the  user  was  in  the  form  of  a  Likert  scale  from  one  to 
seven  ranging  from  highly  disagreeing  to  highly  agree  respectively.  Each  of  the  project  area 
statistics  was  then  summarized  into  a  user-friendly  chart  for  managerial  evaluation  of  the  project. 
(Pinto  and  Slevin,  1992) 

Although  far  more  generic  for  this  study’s  use,  the  Project  Implementation  Profile  provided 
this  study  with  a  basic  format  from  which  to  benchmark  its  own  AR&SC  specific  tool. 
Specifically,  the  two  ideas  borrowed  from  it  are  parts  of  the  tool’s  format,  and  user  flow.  It  is 
important  to  point  out,  however,  that  the  PCAT  only  faintly  reflects  those  ideas  of  this  more 
generic  tool.  The  structure  of  the  PCAT  system  can  be  divided  into  three  areas,  the  PCAT 
design,  the  PCAT  Summary,  and  the  PCAT  User  Flow  . 

PCAT  Design.  The  PCAT  design  consistently  implements  the  rules  of  user  simplicity  and 
strategic  managerial  feedback.  It  is  divided  up  into  three  sections  reflecting  the  key  competitive 
factors  of  Politics,  Cost  and  Organics.  Under  each  of  the  factors  headings,  the  tool  proceeds  to 
be  broken  down  further  into  subsections  describing  the  particular  factor.  It  is  in  these 
subsections  that  items  are  brought  to  the  user’s  attention  in  the  form  of  questions  relating  to  the 
factor.  The  questions  are  based  on  data  obtained  from  the  survey  work.  It  is  important  to  point 
out  that  every  question  posed  to  the  AR&SC  user  can  be  traced  back  through  the  Delphi 
verification  process  to  its  source  in  the  initial  literary  research  for  the  study.  In  other  words,  the 
questions,  and  the  information  they  represent,  have  been  seen  twice  before  in  the  process  of  this 
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study.  Because  this  information  has  been  spoken  about  in  detail  previously,  there  will  be  no 
further  detail  provided  on  the  questions  content  suffice  to  say  that  there  is  no  new  information  to 
introduce. 

A  Likert  Scale  is  used  as  the  measurement  interface  between  the  tool  and  the  AR&SC  user. 
Once  again,  it  reflects  a  scale  of  agreement  using  the  descriptions  Disagree,  Moderately 
Disagree,  Neutral,  Moderately  Agree,  and  Agree.  Although  other  versions  of  the  Likert  Scale 
were  investigated  for  use,  it  was  decided  to  use  the  same  scale  implemented  in  the  survey 
process.  This  decision  did  two  things.  First,  it  lowered  the  risk  of  using  an  untried  scale  on  a 
key  deliverable  of  the  study.  Secondly,  it  ended  up  providing  a  standard  response  mechanism 
throughout  all  of  the  study’s  deliverables  limiting  potential  complexity  for  any  future  reader. 

At  the  end  of  each  section,  the  Likert  responses  are  totaled  to  obtain  an  average  response  for 
the  subsection.  The  subsection  averages  are  then  totaled  themselves  to  obtain  an  average  for  the 
entire  key  competitive  factor.  This  is  all  done  using  the  Microsoft  excel  program.  Figure  1 1 
displays  an  example  of  the  PCAT.  However,  the  entire  PCAT  can  be  viewed  in  Appendix  D. 
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POLITICS  1.0 


The  following  questions  address  the  Factor  of  Politics.  For  competitive 
preparation,  politics  is  defined  as  the  protection  of public  entity  self  interests 
before  and  during  a  public-private  competition.  In  other  words,  it  is  the 
intentional  acts  of  influence  to  enhance  or  protect  the  self-interest  of 
individuals  or  groups 


Sub  Factor  1.1 

Mobilization  of  ELECTED  Officials 

This  first  subsection  deals  with  the  mobilization  of  elected  political  pressure 
in  favor  of  a  public  entity.  This  pressure  is  defined  as  political  influence  from 
Congressman,  Senators,  State  Governors,  State  Legislators,  and  local 
politicians  in  support  of  constituencies  ’  needs  and  wants. 


1.1.1  Federal  Political  Pressure 


1 

North  Carolina  Representatives  are  aware  of  the  potential  Deepwater  Program 
outsourcing  threatening  AR&SC. 

2 

North  Carolina  Senators  are  aware  of  the  potential  Deepwater  Program 
outsourcing  threatening  AR&SC. 

3 

Virginia  Representatives  are  aware  of  the  potential  Deepwater  Program 
outsourcing  threatening  AR&SC. 

4 

Virginia  Senators  are  aware  of  the  potential  Deepwater  Program  outsourcing 
threatening  AR&SC. 

Total 

Average 

Figure  11.  Example  of  PCAT 


PC  AT  Summary.  This  Factor  Average,  along  with  the  other  two  Factor  Averages  obtained 
using  the  same  method  described  above,  provides  AR&SC  management  with  a  high  level 
assessment  of  where  the  organization  stands  in  reference  to  it’s  competitiveness  in  a  workload 
competition.  These  important  statistics  are  summarized  for  the  AR&SC  management  team  in  the 
PCAT  Summary  Sheet.  This  particular  display  serves  the  users  by  providing  a  quick  and  user- 
friendly  overview  of  the  team’s  assessment.  True  to  the  strategic  rule  of  design,  it  does  not  go 
into  the  details  of  each  sub  factor,  however,  this  summary  does  not  excuse  the  user  from  further 
investigation.  The  PCAT  Summary  Sheet  simply  points  the  AR&SC  user  in  a  specific  direction 
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for  further  study  to  find  out  why  a  sub  factor  might  have  a  low  score.  As  will  be  seen  in  the 
section,  this  investigation  is  incorporated  into  the  PCAT  system  flow.  An  example  of  the  PCAT 
Summary  Sheet  can  be  seen  in  Figure  12. 


PCAT  SUMMARY 


POLITICS  FACTOR 

1.1  Mobilization  of  ELECTED  Officials 

1.2  Utilization  of  Private  Interest  Groups 


COST  FACTOR 

2.1  Applying  a  Managerial  Cost  System 

2.2  Integrating  a  Cost  System 

2.3  Reengineer  Processes  to  Become  Cost  Competitive 

2.4  Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 


ORGANIC  FACTOR 

3.1  Identification  of  Core  Competencies 

3.2  Highlight  Overhead  and  Excess  Capacity 

3.3  Utilize  Expertise  and  Corporate  Knowledge 

3.4  Highlight  Readiness  Capability  of  the  Public  Entity 

3.5  Advertise  Reliable  Support  Infrastructure  of  a  Public  Entity 

3.6  Develop  Public  Performance  Guarantees  to  be  Competitive  in  a  Public 
Private  Competition 

3.7  Preparing  a  Competitive  Public  Entity  Proposal  for  a  Public  Private 
Competition 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

Figure  12.  PCAT  Summary  Sheet 


PCAT  System  Flow.  A  PCAT  Flow  Chart  can  be  seen  in  Appendix  E.  Upon  review  of  this 
system  flow,  the  user  is  taken  through  a  series  of  events  eventually  calumniating  in  the 
preparation  of  AR&SC  to  submit  a  competitive  proposal.  It  must  be  noted  that  the  PCAT  system 
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flow  emphasizes  the  use  of  this  tool  by  a  management  team.  This  is  to  ensure  that  the  all¬ 
pertinent  areas  of  AR&SC  are  represented  in  the  evaluation;  this  fact  will  ensure  that  the 
feedback  provided  by  the  tool  is  the  most  up  to  date  and  useful  for  all  product  lines. 

As  the  chart  continues  to  flow  downward,  the  user  is  asked  the  question  if  any  section  or 
subsection  was  critical  as  defined  by  an  average  of  3.0  or  below.  This  was  selected  as  the  critical 
point  because  the  statistic  3.0  represents  the  neutral  opinion  on  the  Likert  Scale.  It  was  decided 
that  any  item  rated  as  neutral  or  below,  in  the  context  of  this  assessment,  would  be  considered 
noncomplying  to  the  efforts  associated  with  a  competitive  public  organization.  The  fact  that 
there  are  two  levels  below  the  neutral  serves  to  provide  a  measurement  on  how  badly  the  team  is 
ignoring  a  particular  competitive  item. 

If  one  of  the  subsections  are  critical,  then  the  user  would  be  obligated  to  review  that 
subsection  for  individual  critical  items  3.0  or  below.  If  the  subsection  was  above  3.0,  then  the 
user  has  the  option  of  reviewing  the  individual  items  under  a  particular  subsection;  this  would  be 
done  only  if  the  user  feels  that  there  is  room  for  improvement  in  some  particular  areas. 

Upon  identification,  those  critical  items  will  then  be  set  in  a  prioritized  list  for  the  purpose  of 
developing  Action  Plans.  It  would  be  the  goal  of  these  plans  to  bring  those  critical  items  above  a 
3.0  in  the  next  group  assessment.  Each  plan  would  consist  of  management’s  specific  directives 
on  how  it  would  address  the  critical  item  to  be  more  competitive. 

Prior  to  the  execution  of  the  Action  Plans,  a  question  has  been  purposely  designed  into  the 
instrument’s  flow.  This  question  forces  the  team  to  inquire,  as  a  very  last  check  prior  to 
implementing  the  Action  Plans,  if  there  has  been  any  recent  changes  in  the  IDS  threat  that  would 
effect  the  assessment  thus  far.  If  there  has  not,  then  work  on  Action  Plans  would  proceed  as 
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scheduled.  However,  if  there  has  been  a  significant  change,  it  directs  the  group  to  quickly 
conduct  another  assessment  prior  to  dedicating  time  and  resources  on  any  Action  Plan. 

After  it  is  decided  to  implement  the  Action  Plans,  the  user  is  asked  if  it  has  been  one  month 
since  the  beginning  of  the  assessment.  The  purpose  of  this  question  is  three  fold.  First,  it 
ensures  that  the  AR&SC  is  not  constantly  in  the  assessment  mode  by  forcing  the  user  to  forego 
additional  evaluations  for  one  month.  Secondly,  it  ensures  that  the  user  reassesses  AR&SC ’s 
progress  at  a  minimum  of  once  a  month.  Finally,  it  ensures  the  tool’s  timeline  is  conducive  to 
progressing  action  plans,  while  simultaneously,  providing  a  catalyst  to  prevent  those  same 
projects  from  wither  away  due  to  lack  of  visibility  or  a  perceived  lack  of  commitment.  This  step 
can  be  considered  a  safety  valve  for  long-term  structure  and  continued  effort. 

If  it  has  not  been  one  month  since  the  beginning  of  the  evaluation,  this  could  mean  two  things 
depending  upon  where  the  user  is  in  the  big  picture  process.  First,  it  could  simply  indicate  that 
the  user  has  not  cleared  one  month  and  should  continue  working  on  the  Action  Plans  until  one 
month  passes.  This  would  be  indicated  by  sections  and  subsections  of  the  PCAT  still  being  at  or 
below  the  critical  value  of  3.0.  However,  it  could  alternatively  indicate  that  competitive 
preparation  has  been  excellent  implying  there  are  no  more  critical  items  required  to  be  addressed 
by  AR&SC  management. 

Having  all  PCAT  sections  above  the  critical  value  of  3.0  is  a  key  indictor  of  successful  public 
private  competition  preparedness.  Once  this  point  is  reached  in  the  PCAT  process,  AR&SC ’s 
next  step  would  be  to  submit  a  proposal  for  competitive  consideration  for  the  IDS  program 
workloads.  This  is  the  goal  of  the  Public  Private  Competition  Assessment  Tool  for  AR&SC.  If 
all  these  PCAT  Factors  are  properly  addressed,  then  AR&SC  can  be  considered  highly 
competitive  for  a  Deepwater  workload. 
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Testing  of  the  PCAT 

Upon  completion  of  the  PCAT  prototype,  it  was  then  pilot  tested  utilizing  two  graduate 
students  at  the  Air  Force  Institute  of  Technology.  The  purpose  of  this  test  was  not  to  inquire 
about  content,  but  to  ensure  the  mechanical  integrity  and  usability  of  the  instrument.  This  test 
was  completed  without  any  significant  changes  to  the  instrument  flow  or  readability.  Of 
particular  interest  was  a  remark  made  by  one  of  the  of  the  student  evaluators.  In  his  remark,  he 
mentions  how  easy  it  was  to  navigate  the  tool  as  an  outsider  for  the  first  time.  This  was  of 
particular  interest  to  the  researcher  because  ease  of  use  was  an  original  design  guidance. 

Beta  Use  of  the  PCAT 

Upon  completion  of  the  local  testing,  the  PCAT  was  sent  via  electronic  mail  to  key 
management  representatives  at  AR&SC.  This  was  done  two  accomplish  two  objectives.  First,  it 
was  done  to  beta  test  the  PCAT  instrument  for  appropriate  content  indigenous  to  the  depot  itself. 
The  Beta  PCAT  contained  locally  oriented  questions  based  on  interviews  and  professional 
personal  knowledge  of  AR&SC  workload  processes  and  product  lines.  Because  of  this,  every 
effort  was  made  to  ensure  that  potential  AR&SC  users  reviewed  depot  references  for  its 
accuracy. 

Secondly,  and  most  importantly,  the  Beta  PCAT  was  sent  to  AR&SC  management  to  obtain 
an  initial  assessment  of  AR&SC  in  reference  to  preparation  for  a  public  private  competition. 
Completion  of  this  initial  assessment  provided  the  answer  to  the  second  thesis  question.  To 
review,  this  question  is  the  following: 

What  is  the  Aircraft  Repair  and  Supply  Center’s  overall  position  in  addressing  these  key 

factors  to  create  a  competitive  public  proposal  for  a  managed  competition? 
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Upon  obtaining  the  Beta  PCAT,  AR&SC  management  was  instructed  to  fill  out  the 
assessment  individually.  Feedback  from  the  Beta  PCAT  was  returned  from  AR&SC 
management  representatives  via  the  electronic  mail  system.  Upon  receipt  of  the  individual 
responses,  a  group  average  for  each  key  factor  was  completed  in  a  Microsoft  Excel  spreadsheet. 
Following  this  data  review,  a  written  assessment  was  finally  completed  to  document  this  key 
deliverable,  the  competitive  position  of  AR&SC.  The  AR&SC  management  participating  in  the 
Beta  PCAT  assessment  is  presented  in  Table  2. 

Table  2.  Participating  AR&SC  Management  Positions 


Position 

Rank 

Commanding  Officer 

0-6 

Executive  Officer 

0-5 

HH-65A/B  Product  Line  Manager 

0-5 

HC-130H  Product  Line  Manager 

0-5 

Chief  Contracting  Officer 

0-5 

Chief  Financial  Officer 

0-5 

The  feedback  statistics  along  with  the  competitive  position  assessment  will  be  further  discussed 
in  the  next  chapters. 
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IV.  Data  Descriptions  and  Analysis 


Introduction 

The  first  goal  of  this  chapter  is  to  provide  the  procedures  utilized,  and  present  the  results 
obtained  of  the  Delphi  study.  The  raw  data  for  each  of  the  three  rounds  can  be  found  in 
Appendix  F,  G,  and  H. 

The  second  goal  of  this  chapter  is  to  present  the  content  development  of  the  Public-Private 
Competitive  Assessment  Tool  (PCAT);  the  PCAT  continuity  with  the  Research  Model,  and, 
finally,  the  results  of  its  Beta  Use  at  the  U.S.  Coast  Guard  Aircraft  Repair  and  Supply  Center. 

Round  One  of  the  Delphi  Process 

There  were  two  objectives  for  round  one.  The  first  objective  was  to  validate  the  public 
private  competition  research  model  presented  in  chapter  two  of  this  study.  The  second  objective 
was  to  interrogate  experts  in  the  field  of  managed  competition  to  access  additional  information 
for  incorporation  into  the  model  or  to  improve  the  existing  model  structure. 

Every  effort  was  made  to  exploit  data  gathering  opportunities  created  by  experts  filling  out 
the  survey  instruments.  In  this  first  round,  the  survey  questions  were  directly  traceable  to  the 
factors  and  sub  factors  creating  the  research  model’s  structure.  To  capture  the  expert  thoughts  on 
a  particular  question,  the  expert  was  provided  space  allowing  further  explanation  of  their 
response  position.  In  addition,  to  further  this  endeavor,  there  were  open-ended  questions  located 
at  the  end  of  each  segment;  these  simply  asked  if  the  expert  wanted  to  add  or  present  new 
information  to  the  survey  researcher.  The  first  survey  had  seventy-four  questions.  As  stated  in 
chapter  three,  a  five-point  Likert  scale  was  used  for  this  survey  and  subsequent  instruments. 
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Results  of  Survey  One 

The  rate  of  response  on  the  first  survey  was  100%;  the  use  of  electronic  mail  greatly 
facilitated  this  statistic.  After  an  initial  review,  the  survey  data  was  entered  into  a  previously 
prepared  Microsoft  Excel  spreadsheet.  As  programmed,  the  spreadsheet  computed  the  Mean, 
Median,  and  Standard  Deviation  for  all  questions.  Table  3  below  shows  an  example  of  this  raw 
data  spreadsheet.  The  complete  spreadsheet  can  be  found  in  Appendix  F. 


Table  3.  Survey  One  Raw  Data  Example 


QUESTION 

# 

EXP  1 

EXP  2 

AVG 

STD  DEV 

MEDIAN 

1 

1 

3 

ii 

4.000 

1.414 

4.500 

2 

1 

3 

ii 

2.125 

1.126 

2.000 

3 

3 

5 

ii 

4.375 

0.916 

5.000 

4 

5 

4 

ii 

3.750 

1.389 

4.000 

5 

5 

4 

ii 

3.250 

1.669 

4.000 

m 

ii 

ii 

ii 

ii 

ii 

ii 

Formulation  of  Survey  Two 

From  the  raw  data  for  survey  one,  the  data  was  further  interrogated  for  information.  First,  the 
raw  data  set  was  sorted  by  each  question’s  mean  and  median  in  descending  order.  Upon 
completion  of  the  sort,  a  threshold  value  of  3.0  was  applied  to  list.  Both  the  mean  and  median 
sorts  were  compared  after  the  threshold  was  applied;  there  were  no  significant  differences  that 
would  have  resulted  in  different  question  dismissals. 

The  differences  that  did  exist  consisted  of  an  overlap  of  only  two  questions.  A  comparison 
conducted  of  round  one  threshold  data  shows  that  this  entailed  an  overlap  of  questions  #9  and 
#69.  Both  of  these  questions  were,  as  will  be  explained  later  in  this  chapter,  dismissed  from  the 
study.  As  a  result,  this  effectively  normalized  the  difference  between  the  two  mean  and  median 
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sorts.  An  example  of  this  mean  and  median  threshold  comparison,  including  the  overlap,  is 
provided  in  Table  4. 


Table  4.  Example  of  the  Threshold  Spreadsheet 


SORTED  BY  MEAN  SORTED  BY  MEDIAN 

Q# 

AVG 

STD  DEV 

MEDIAN 

Q# 

AVG 

STD  DEV 

MEDIAN 

II 

m 

ii 

ii 

ii 

ii 

ii 

ii 

27 

3.125 

1.808 

3 

27 

3.125 

1.808 

3 

9 

2.875 

1.808 

3 

9 

2.875 

1.808 

3 

69 

2.75 

1.035 

3 

69 

2.75 

1.035 

3 

21 

2.625 

1.598 

2.5 

21 

2.625 

1.598 

2.5 

2 

2.125 

1.126 

2 

2 

2.125 

1.126 

2 

36 

2.125 

1.553 

1.5 

36 

2.125 

1.553 

1.5 

10 

1.75 

1.165 

1 

10 

1.75 

1.165 

1 

m 

ii 

ii 

ii 

ii 

ii 

ii 

ii 

Because  there  were  no  significant  differences,  and  due  to  its  use  in  previous  studies,  the  mean 
designated  as  the  primary  threshold  measurement.  However,  it  must  be  pointed  out  that  the 
median,  because  of  its  validity  in  previous  Delphi  studies,  will  continue  to  be  used  as  a 
secondary  statistic  to  compare  the  threshold  sorts  of  future  rounds. (Dickson  and  Leitheiser, 

1984) 

As  a  result  of  this  threshold  application,  averages  3.0  and  above  were  retained  for  the  second 
round,  and  those  below  3.0  mean  were  deleted  from  the  active  question  list.  As  stated  in  chapter 
three,  the  value  of  3.0  was  selected  due  to  its  use  in  precedent  Delphi  studies. (Scheffler  and 
Logan,  1999)  This  cut  resulted  in  an  initial  loss  of  seven  questions  from  the  survey  list.  These 
deleted  questions  are  presented  in  Figure  13. 
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2  Individually  targeted  congressional  pressure  can  affect  source  selection  team  member 
decisions  in  a  public  private  competition. 

6  Congressional  staffers,  representing  their  superior’s  agenda,  solicit  individual  members  of 
the  source  selection  team  during  a  public  private  competition. 

9  Public  entities  are  unable  to  directly  participate  in  the  influential  political  tools  available 
to  interest  groups. 

1 0  Interest  groups  (other  than  congressional  offices)  solicit  the  source  selection  teams  during 
a  public  private  competition 

21  Costs  associated  with  overhead  and  other  indirect  costs,  such  as  those  associated  with 
administrative  support  and  capital  setups,  are  not  accounted  for  in  the  present  public 
entity  costing. 

36  Any  ability  to  access  outside  assistance  tends  to  tilt  competitiveness  in  favor  of  the 
private  sector. 

69  These  post  award,  financial  or  contractual  criteria  can  be  a  positive  disrupter  of  a 

competition;  the  public  entity  can  incorporate  a  well-developed  criteria  into  the  proposal 
effectively  tilting  the  competition  in  favor  of  the  public  entry. 


Figure  13.  Questions  below  3.0  Mean  Thresholds 


Although  initially  deleted  from  the  active  survey  list,  these  seven  questions  did  not  lose  all 
value  to  the  survey  process.  These  questions,  and  their  accompanying  expert  comments,  were 
reexamined  to  find  out  if  any  were  written  in  too  confusing  a  manner  or  in  a  manner 
misrepresentative  of  the  intended  question  topic.  Upon  completion  of  this  review,  two  questions 
were  identified  to  be  in  need  of  rewrite.  These  were  questions  number  21  and  number  36. 

Rewritten  Questions.  The  first  question,  number  2 1  was  presented  to  the  expert  responder  in 
the  following  text  and  manner. 

Costs  associated  with  overhead  and  other  indirect  costs,  such  as  those  associated  with 
administrative  support  and  capital  setups,  are  not  accounted  for  in  the  present  public  entity 
costing. 
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The  problem  with  this  question  existed  entirely  in  the  presentation.  In  other  words,  it  was 
written  in  a  manner  that  did  not  properly  convey  the  researchers  intent.  The  problem  lies  in  the 
definition  of  not  accounted  for  in  the  present  public  entity.  The  intent  was  to  convey  that  public 
entities  do  not  account  for  overhead  and  indirect  costs  in  a  standard  manner.  What  came  across 
to  the  expert  respondent  was  that  the  public  entity  did  not  account  for  these  costs  at  all. 

Feedback,  both  numerical  and  written,  from  five  of  the  eight  experts,  pointed  to  this  being  a 
weakness  of  the  question.  As  a  result,  the  question  was  reworded  in  the  following  manner  for 
inclusion  into  the  second  survey. 

Overhead  and  other  indirect  costs,  such  as  those  associated  with  administrative  support  and 
capital  setups,  are  accounted  for  by  public  entities,  however,  their  non-standard 
methodologies  are  not  widely  accepted  or  trusted  by  the  private  business  environment. 

The  question  was  renamed  for  survey  two  with  the  inclusion  of  an  R  after  the  number. 
Question  21  from  survey  one  became  question  21R  for  survey  two. 

Question  number  36  also  was  identified  as  a  potential  rewrite  candidate.  It  was 
presented  in  the  following  text  and  manner. 

Any  ability  to  access  outside  assistance  tends  to  tilt  competitiveness  in  favor  of  the  private 
sector. 

Upon  review  of  the  feedback  for  this  question,  it  was  clear  what  caused  such  low  scores  and 

unpopular  comments.  This  question  simply  contained  a  typing  error,  however,  the  error  was 

completely  crucial  to  the  meaning  of  the  question.  This  resulted  in  confusion  on  the  part  of  the 

experts.  The  mistake  was  in  the  word  ability,  it  should  have  been  written  as  inability.  After 

review,  the  question  was  rewritten  with  the  intended  grammar  in  the  following  manner. 

Inability  of  the  Public  Entity  to  access  outside  assistance  tends  to  tilt  competitiveness  in  favor 
of  the  private  sector. 
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Once  again,  the  renaming  procedure  was  utilized.  The  question  number  36  became  36R  for 
survey  two.  It  is  important  to  point  out  that  both  renamed  questions  were  kept  with  the  same 
identification  throughout  the  entire  Delphi  process.  Upon  completion  of  the  rewrites  of  question 
21R  and  36R,  the  remaining  five  questions  were  dropped  permanently  from  the  study. 

New  Questions.  The  experts,  through  their  comments  and  question  feedback,  provided  new 
topics  for  the  study.  Both  types  of  written  feedback,  the  question  comments  and  the  open-ended 
questions,  produced  a  similar  share  of  new  factors  pertinent  to  the  study.  As  stated  earlier,  five 
questions  were  highly  disagreed  upon  by  the  experts  and  dismissed  from  the  study.  It  is, 
however,  very  interesting  to  note  that  the  comments  generated  from  these  unpopular  questions 
provided  feedback  for  the  many  of  the  new  topics  as  well. 

All  of  the  feedback  was  placed  into  aggregate  lists  and  then  grouped  according  to  a  common 
topic  or  factor.  An  interesting  point  is  that  the  feedback  did  not  necessarily  reflect  the  question 
or  area  where  it  was  found  in  the  first  survey.  Although  surprising  in  the  mechanics,  it  does 
indicate  that  the  survey  instrument  did  what  it  was  designed  to  do  which  was  to  tap  into  the 
expert’s  knowledge  pool. 

Upon  completion  of  this  review,  these  new  topics  were  formulated  into  questions  and  then 
assigned  according  to  the  most  pertinent  factor  area  in  the  survey  instrument.  They  were  then 
integrated  into  the  survey  instrument  being  placed  after  each  subsection’s  open-ended  question. 
These  new  questions  were  named  according  to  the  open-ended  question  it  trailed,  and  then  by  a 
numeral  reflecting  the  number  of  the  new  question.  This  was  then  followed  by  the  letter  N 
signifying  new.  An  example  of  this  placement  and  numbering  scheme  can  be  seen  in  Figure  14. 
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7 

In  your  past  experiences  or  studies  are  there  any  other  points 
in  Congressional  mobilization  that  should  be  mentioned  or 
addressed  to  be  included  in  this  study? 

7-1-N 

Congressional  policy  decisions,  which  affect  how 
competitions  are  conducted,  could  potentially  influence  the 
competition  results. 

1  2  3  4  5 

Comments: 

7-2-N 

Congressional  Oversight,  such  as  in  the  form  of  the  General 
Accounting  Office  (GAO),  can  influence  the  behavior  of  a 
source  selection  team. 

1  2  3  4  5 

Comments: 

Figure  14.  Example  of  New  Question  Naming  and  Placement  Convention 


A  detailed  list  of  the  new  questions  incorporated  into  survey  two  can  be  referenced  in  Figure 
15.  Please  note  that  the  particular  factor  areas  were  these  questions  are  assigned  are  not 
represented.  The  entire  second  survey,  with  questions  in  their  respective  categories,  can  be 
referenced  in  Appendix  B. 
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7-1  -N  Congressional  policy  decisions,  which  affect  how  competitions  are  conducted, 
could  potentially  influence  the  competition  results. 

7-2-N  Congressional  Oversight,  such  as  in  the  form  of  the  General  Accounting  Office 
(GAO),  can  influence  the  behavior  of  a  source  selection  team. 

1 3-1  -N  Public  private  consortiums  may  be  able  to  put  forth  a  stronger  proposal  than  a 
public  entity  acting  alone  because:  of  the  past  performance,  experience,  and 
capability  of  the  private  partner. 

1 3-2-N  Public  private  consortiums  may  be  able  to  put  forth  a  stronger  proposal  than  a 
public  entity  alone  because:  of  the  reduction  of  risk  achievable  through  keeping 
the  work  in  place  vs.  moving  the  workload  to  new  facilities  with  a  new 
workforce. 

1 3-3- N  Public  entities  need  to  pay  attention  to  labor  unions  since  the  public  entity  may 
want  to  propose  such  techniques  as,  for  example,  multi-skilled  job  positions. 

1 3-4-N  State  and  Local  legislatures  should  be  considered  as  interest  groups,  in 

particular  if  the  public  entity  proposal  includes  improvements  to  buildings  or 
new  facilities.  For  example,  State  and  Local  funding  could  offset  these  costs. 

25-1  -N  Inability  to  get  new  systems  on  board  (and  integrated  with  older  data  bases)  is  a 
reason  public  entities  fail  to  implement  any  system  to  account  for  costs. 

37-1 -N  Consultants  should  be  used  alongside  technical  experts  of  the  public  entity  to 
develop  a  proposal 

74-1  -N  Outside  consultants  should  not  be  driving  the  final  product  (proposal),  they 

_ should  be  there  to  assist  with  identification  of  all  potential  proposal  inputs  only. 

Figure  15.  New  Questions  included  in  Survey  Two 


Feedback  for  the  Experts.  In  a  Delphi  technique,  feedback  is  important  because  it  forms  the 
sole  means  of  internal  group  communications  in  the  Delphi  process. (Skutsch  and  Scheibe,  1975) 
During  this  and  subsequent  rounds  of  the  survey  process,  each  expert  was  provided  an 
individually  prepared  survey.  The  group  mean  for  each  question,  as  well  as  the  expert’s  previous 
round’s  answer,  was  included  between  the  naming  numeral  and  the  text  of  the  question.  Of 
course,  the  new  and  rewritten  questions  did  not  include  this  feedback  information.  However,  as 
will  be  seen  in  the  upcoming  third  survey,  these  feedback  statistics  were  eventually  incorporated 
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into  the  questions.  An  example  of  this  survey  feedback  integration  can  be  seen  in  Figure  16. 
Please  note  the  questions  deleted  from  survey  one  are  recognized  with  their  previous  number  and 
a  text  stating  Intentionally  Left  Blank.  This  provides  information  back  to  the  expert,  as  well  as, 
facilitates  the  integrity  of  the  numbering  scheme. 


Mobilization  of  Congressional  Pressures 

This  first  subsection  deals  with  the  mobilization  of  congressional  pressures  in 
entity.  Congressional  pressure  is  defined  as  political  influence  from  Congress 
their  staff  in  support  of  constituencies  ’  needs  and  wants. 

Turf  Protection  Bureaucrats:  those  noliticians  actively  seeking  to  gain  an  a< 

favor  of  a  public 
•man,  Senators  and 

dvantage  for 

themselves  and  their  constituents 

Group  Your 

AVG  Previous 

1 

4.0 

5 

Congressional  pressure  can  affect  the  level  playing  field  in  a 
public  private  competition. 

Comments: 

1  2  3  4  5 

2 

Intentionally  left  blank 

3 

4.375 

5 

As  a  result  of  public  private  competitions.  Outsourcing  a  public 
entity  (to  include  closure  of  that  public  facility)  may  have 
dramatic  impacts  on  the  subject  area’s  economy,  infrastructure, 
and  financial  worth  . 

Comments: 

1  2  3  4  5 

Figure  16.  Example  of  Feedback  incorporated  into  Survey  Two 


Finally,  a  feedback  tool  was  utilized  in  an  attempt  to  capture  those  experts  whose  answers 
were  outside  of  1.25  standard  deviations  of  the  group  mean  for  the  particular  question.  This 
number  had  been  selected  due  to  its  successful  use  in  a  previous  Delphi  study.  (Barelka,  2001) 
A  Microsoft  Excel  spreadsheet  was  programmed  to  accept  the  raw  data  from  survey  one  and 
determine  which  expert  input  fell  outside  of  these  boundaries.  Those  experts  whom  answered  a 
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question  outside  of  this  1.25  standard  deviation  would  be  queried  for  an  explanation  during  the 
next  survey  round.  On  survey  two,  an  asterisk  was  used  to  indicate  the  subject  question  number. 
It  was  hoped  that  the  results  from  these  queries  could  be  included  in  questions  for  future  rounds. 
An  example  of  this  spreadsheet  can  be  seen  in  Table  5.  The  expert’s  answer  was  outside  of  this 
boundary  if,  in  the  column  on  the  far  right,  there  was  an  indication  of  TRUE. 


Table  5.  Example  of  Round  One  Standard  Deviation  Test 


Round  One  Raw  Data  Breakout 
Question  AVG  STDEV 

1.25 

1.25 

Expert  1 
ANS 

1  OUT 

1 

4 

1.414214 

2.232233 

5.767767 

1 

TRUE 

2 

2.125 

1.125992 

0.71751 

4.78125 

1 

FALSE 

3 

4.375 

0.916125 

3.229843 

9.84375 

3 

TRUE 

4 

3.75 

1.38873 

2.014087 

8.4375 

5 

FALSE 

u 

u 

it 

“ 

“ 

it 

(t 

Round  Two  of  the  Delphi  Process 

The  second  round  of  this  process  had  five  objectives.  The  first  was  retest  the  sixty-eight 
questions  surviving  from  round  one.  The  second  was  to  test  the  two  rewritten  questions.  The 
third  was  to  initiate  testing  of  the  new  questions  developed  from  the  comments  and  open-ended 
questions  of  first  round.  The  fourth  objective  was  to  generate  new  topics  or  factors  that  could 
improve  the  research  model.  Finally,  the  fourth  objective  was  to  obtain  comments  from  those 
experts  who  answered  outside  the  1.25  standard  deviation  boundary.  Once  again,  the  scale  on 
this  survey  used  the  five  point  Likert  Scale. 

Results  of  Round  Two 

The  survey  was  sent  and  received  via  the  electronic  mail  system.  Unfortunately,  there  was 
not  a  100%  response  for  this  second  round.  One  expert  failed  to  respond  to  the  second  survey. 
Although  an  attempt  was  made  to  contact  the  particular  expert,  there  was  simply  no  interest  on 
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his  part  in  continuing  with  the  survey  study.  This  was  unfortunate  because  this  particular  expert 
represented  one  of  the  largest  civil  federal  branches  in  the  Department  of  Transportation. 
However,  as  will  be  seen  later  in  this  chapter,  this  input  loss  was  not  a  barrier  to  successful  data 
gathering  for  public  private  competitions. 

Once  obtained,  the  raw  data  was  input  into  the  Microsoft  Excel  spreadsheet  as  had  been  done 
during  the  first  round.  An  attempt  was  made  to  reduce  the  data  as  in  the  first  round;  however, 
there  was  no  response  that  fell  below  the  3.0  threshold.  This  included  both  the  rewritten  and  new 
questions  incorporated  from  round  one.  Once  again,  both  the  mean  and  threshold  were 
compared  with  no  significant  differences.  This  entire  threshold  evaluation  is  provided  in 
Appendix  1. 

The  following  is  considered  a  milestone  in  this  Delphi  study.  By  simply  looking  at  the  raw 
data  in  comparison  with  the  raw  data  for  round  one,  there  appears  to  be  the  beginning  of 
consensus  taking  place.  The  standard  deviations  for  each  question,  with  exception  of  the 
rewritten  and  new  questions,  have  done  one  of  two  things.  They  have  stayed  the  same  indicating 
the  experts  may  not  get  any  closer  in  agreement,  or  they  have  actually  decreased  indicating  more 
agreement  on  the  particular  topic.  In  chapter  three,  consensus  was  defined  as  a  trend  toward  a 
decreasing  standard  deviation  of  zero  or  simply  zero  after  three  rounds.(Dickson  and  Leitheiser, 
1984)  Therefore,  at  this  mid  stage  of  the  Delphi  technique,  there  appears  to  be  indications  of  this 
consensus  taking  place.  An  example  of  this  trend  toward  consensus  can  be  seen  in  Table  6.  The 
differences  between  the  first  round  and  the  second  round  are  displayed.  Please  note  that  the  first 
round  data  is  reflective  of  the  one  less  expert.  This  constitutes  apples  to  apples  comparison  of 
data. 
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Table  6.  Standard  Deviation  Delta  from  Round  One  and  Round  Two 


SURVEY 

1 

Mean 

SURVEY  1 

Std  Dev 

SURVEY 

2 

Mean 

SURVEY  2 

Std  Dev 

Change  in 
Std  Dev 

1 

4.428571 

0.78679579 

4.428571 

0.786795792 

0 

2 

0 

0 

0 

0 

0 

3 

4.571429 

0.78679579 

4.428571 

0.786795792 

0 

4 

3.571429 

1.39727626 

3.857143 

0.690065559 

0.707211 

5 

3 

1.63299316 

3.571429 

1.272418021 

0.360575 

m 

ii 

ii 

ii 

ii 

ii 

To  further  display  this  trend  toward  consensus,  Figure  17  has  been  presented.  In  it  the  first 
five  items  presented  in  Table  6  are  displayed  graphically  for  the  reader.  This  clearly  and  visually 
indicates  this  trend  toward  zero  in  the  standard  deviations.  Please  note  that  question  #2  was 
dismissed  from  the  survey  earlier  and,  therefore,  is  not  represented  in  Figure  1 7.  An  assessment 
using  the  spreadsheet  was  conducted  for  each  question  in  the  survey  two.  The  entire  spreadsheet 
assessing  all  round  two  differences  in  standard  deviations  may  be  found  in  Appendix  J. 


Standard  Deviation  Delta  from  Round  One  to  Round  Two 


1  2 


Round 


Figure  17.  First  Four  Survey  Questions  and  Trend  Toward  Consensus 
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Preparation  of  Survey  Three 

The  round  two  responses  were  reviewed  for  feedback  in  the  form  of  comments. 

Unexpected  was  the  fact  that  the  experts,  whom  were  asked  to  comment  on  why  they  answered  a 
question  outside  of  the  1.25  standard  deviations  of  the  group  mean,  failed  to  provide  the 
requested  feedback.  For  those  experts  that  did  respond  to  the  asterisk,  it  became  unclear  if  their 
comment  was  about  the  previous  rating  or  about  the  present  rating  they  were  giving  the  question. 
The  same  could  be  said  if  the  expert  simply  did  not  respond  with  a  comment  at  all.  This 
confusion  seemed  to  be  the  result  of  a  design  weakness  in  the  survey. 

Because  the  survey  questions  were  producing  written  feedback,  and  the  feedback  was  more 
positive  than  critical  of  the  referenced  questions,  it  was  decided  to  simply  drop  the  1.25 
boundary  test  limitation.  It  was  determined  that  the  experts’  comments,  from  this  round  and  the 
previous  round,  were  already  capturing  the  reasons  behind  selecting  one  Likert  scale  rating  over 
another.  So,  the  fact  that  they  were  inside  or  outside  an  imaginary  boundary  really  did  not 
matter;  the  experts  were  including  the  feedback  commentary  regardless  of  any  particular 
instructions.  Once  again,  this  indicates  that  the  survey  instrument,  in  the  macro  sense,  was  doing 
exactly  what  it  was  designed  to  do,  produce  plausible  knowledge  comments  on  the  managed 
competition  concept. 

Rewritten  Questions.  Upon  review,  there  were  no  sorted  questions  below  the  threshold,  as 
well  as,  no  critical  comments  provided  by  the  experts.  As  a  result,  there  were  no  questions 
requiring  editing  or  complete  revision. 

New  Questions.  Just  as  with  the  round  one  data,  all  of  the  comments  for  round  two  were  put 
into  an  aggregate  list.  They  were  then  grouped  according  to  a  common  topic  or  factor.  Once 
again,  the  feedback  did  not  necessarily  reflect  the  question  or  area  where  it  was  found  in  the  first 
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survey.  In  the  overall  scheme  of  the  study,  this  written  feedback  was  exactly  what  was  requested 
and  hoped  for  from  the  experts,  however,  it  was  not  conducive  to  quick  review  on  the  part  of  the 
researcher.  Upon  reflection,  this  could  have  been  more  organized  simply  by  requesting  from  the 
beginning  that  the  experts  attempt  to  classify  their  own  comments  into  the  proper  categories. 
However,  the  addition  of  this  rule  could  have  become  a  bander  for  capturing  the  targeted  tacit 
knowledge.  If  constrained,  the  experts  may  not  have  responded  like  they  did  had  in  the  first 
round.  This  is  something  to  keep  in  mind  for  future  studies.  Because  of  this  fact,  there  will  be 
no  change  in  the  methodology  for  obtaining  expert  comments  during  the  third  round. 

Upon  completion  of  this  review,  it  was  determined  that  there  were  no  new  topics  or  factors 
introduced  by  the  experts.  Again,  the  written  comments  received  were  basically  providing 
additional,  more  in-depth  information  on  the  particular  topic.  In  addition,  there  were  also  some 
comments  that  provided  good  insight  on  why  the  expert  did  not  agree;  this  provided  a  good 
source  of  information  as  well.  An  example  of  the  comments  for  question  #  7-2-N  can  be  seen  in 
Figure  18.  As  can  be  seen,  the  comments  proved  to  be  rich  with  additional  information. 
Additional  comments  from  the  experts  will  be  further  explored  in  chapter  five  of  this  study. 
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Question 


7-2-N  Congressional  Oversight,  such  as  in  the  form  of  the  General  Accounting 
Office  (GAO),  can  influence  the  behavior  of  a  source  selection  team. 

Comments 

Expert  # _ 

5  "Absolutely,  the  most  significant  areas  would  be  how  to  evaluate  the 
Governments  existing  facilities  and  establishing  minimum  performance 
criteria." 

6  "In  the  Air  Force  Depot  Competitions  language  was  included  in  the  98 
DoD  Authorization  Act  that  permitted  public  private  teaming,  dealt 
with  fair  market  value  of  facilities,  land  and  equipment,  etc." 

6  "Under  the  98  DoD  Authorization  Act,  the  GAO  was  required  to  review 
documentation  during  the  source  selection  process  for  the  depot 
competitions  at  Sacramento  and  San  Antonio  Air  Logistics  Centers. 

This  caused  the  GAO  discomfort  because  of  a  possible  bias  should  a 

bid  protest  be  filed  with  the  GAO.  In  actuality,  except  for  an  irritation  of 
having  to  provide  the  GAO  with  documentation,  they  were  not  that  intrusive." 

7  "Very  much  so,  although  one  would  trust  that  the  integrity  of  the 

_ competition  process  would  be  the  deciding  factor,  but  don’t  bank  on  it." _ 

Figure  18.  Example  of  Comments  from  Second  Survey 


Because  there  were  no  new  or  rewritten  questions,  the  decision  was  made  to  maintain  the 
integrity  of  the  last  survey  instrument;  there  would  be  no  changes  in  the  design  and  subject 
material. 

Feedback  to  the  Experts.  Due  to  the  lack  of  new  or  rewritten  material,  the  survey  instrument 
to  be  used  in  round  three  was  easily  prepared.  As  stated  earlier,  the  last  round’s  results  indicated 
a  trend  toward  consensus  on  the  survey  questions.  Clearly,  this  was  partly  due  to  the  experts 
reexamining  their  last  answers  in  reference  to  the  group  means.  Because  of  this  successful  use  in 
round  two,  the  group  mean  was  again  provided  for  each  expert  along  with  the  expert’s  last 
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response.  As  before,  the  integration  of  the  expert  responses  required  individual  survey 
instruments  to  be  prepared  for  each  participant.  An  example  of  Expert  #2’s  Survey  Three  can  be 
seen  in  Appendix  K. 

Round  Three  of  the  Delphi  Process 

There  were  four  objectives  for  round  three.  The  first,  and  foremost,  was  to  gain  further 
consensus  on  the  topics  and  factors  listed  in  the  survey  instrument.  The  second  was  to  show  a 
consensus  trend  among  the  new  questions  added  to  the  survey  instrument  in  round  two.  The 
third  was  to  show  a  consensus  trend  among  the  rewritten  questions  added  in  round  two.  Finally, 
the  fourth  was  to  show  that  the  Research  model,  representing  the  factors,  Politics,  Cost,  and 
Organic,  was  validated  as  an  accurate  reflection  of  what  is  important  for  a  public  entity  to  pay 
attention  to  in  preparation  for  a  public  private  competition. 

Results 

The  raw  data  was  collected  and  entered  into  the  same  Microsoft  Excel  spreadsheet  used  for 
each  of  the  other  rounds.  The  mean  and  median  were  once  again  compared  against  the  threshold 
of  3.0  to  maintain  consistency.  There  was  feedback  provided  by  the  experts  on  this  third 
questionnaire,  but  once  again,  it  provided  only  background  information  on  the  topics  and  factors 
already  present  in  the  survey.  It  is  interesting  to  note  that  the  amount  of  written  feedback 
decreased  on  this  round. 

Analysis  and  Findings  of  the  Delphi  Technique 

In  chapter  3,  consensus  was  defined  as  being  reached  when  the  standard  deviations  decreased 
toward  or  became  zero  after  three  rounds  of  the  Delphi  Technique.  As  done  after  round  two,  the 
statistics  were  computed  for  all  of  the  questions.  Once  again,  the  Standard  Deviations  were 
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compared  from  the  second  and  the  third  round.  An  example  of  this  can  be  seen  in  Table  7.  The 
deltas  for  all  questions  were  compared.  The  results  can  be  seen  in  Appendix  L. 


Table  7.  Standard  Deviation  Delta  from  Round  Two  and  Round  Three 


SURVEY 

2 

Mean 

SURVEY 

2 

Std  Dev 

SURVEY 

3 

Mean 

SURVEY 

3 

Std  Dev 

Change  in 
Std  Dev 

1 

4.428571 

0.786796 

4.428571 

0.786796 

0 

2 

0 

0 

0 

0 

0 

3 

4.428571 

0.786796 

4.428571 

0.786796 

0 

4 

3.857143 

0.690066 

4 

0.57735 

0.112715 

5 

3.571429 

1.272418 

3.571429 

1.272418 

0 

m 

ii 

il 

ii 

ii 

ii 

For  many  questions,  however,  one  can  see  that  the  standard  deviations  remained  the  same  in 
between  rounds.  This  indicates  that  the  experts  would  not  move  either  way  on  their  previous 
positions;  therefore,  this  represents  the  best,  most  consistent  level  of  agreement  for  the  particular 
topic  or  factor.  This  dynamic  example  of  two  levels  of  consensus  is  visually  presented  in  Figure 
19.  Due  to  the  number  of  questions  required  to  plot,  only  the  first  five  questions  are  compared 
below  for  the  reader.  Please  note  that  question  one  and  question  three  are  plotted  on  top  of  one 
another. 
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Standard  Deviation  Delta  for  3  Rounds 


Figure  19.  First  Four  Survey  Questions  and  Consensus 


New  Questions  Revisited .  The  second  objective  was  to  show  a  trend  toward 
consensus  for  the  new  questions  introduced  in  the  second  round.  The  data  that  came  back  from 
the  third  round  survey  indicates  that  all  the  questions  were  on  track  to  either  have  stable  or 
decreasing  standard  deviations.  Because  these  are  following  a  similar  trend  as  the  core  questions 
tested  in  three  rounds,  it  will  be  assumed  that  the  consensus  would  have  been  met  if  the  seven 
were  presented  a  third  time  to  the  experts.  Table  8  displays  the  standard  deviations  and  deltas  of 
these  new  questions.  It  should  be  noted  that  comments  received  from  these  new  question,  in  the 
second  round,  were  very  positive  and  agreeable  in  nature.  This  agreeableness  can  be  seen 
quantitatively  in  the  averages  provided  below. 


95 


Table  8.  Standard  Deviation  Delta  for  New  Questions 


SURVEY 

2 

Mean 

SURVEY 

2 

Std  Dev 

SURVEY 

3 

Mean 

SURVEY  1 

3 

Std  Dev 

Change  in 
Std  Dev 

7-1-N 

4.714286 

0.4880 

4.714286 

0.48795 

0.0000 

7-2-N 

3.571429 

1.6183 

3.428571 

1.511858 

0.1065 

13-1-N 

4.428571 

1.1339 

4.428571 

1.133893 

0.0000 

13-2-N 

4.714286 

0.4880 

4.714286 

0.48795 

0.0000 

13-3-N 

4.714286 

0.4880 

4.714286 

0.48795 

0.0000 

1 3-4-N 

4.285714 

0.9512 

4.285714 

0.95119 

0.0000 

25-1 -N 

4.571429 

0.5345 

4.571429 

0.534522 

0.0000 

37-1 -N 

4.571429 

0.534522 

0.0000 

74-1 -N 

4.571429 

0.5345 

4.571429 

0.534522 

0.0000 

Additionally,  Figure  20  has  been  provided  to  graphically  display  this  trend  toward  consensus 
of  the  new  questions. 


Standard  Deviation  Delta  with  New  Questions 
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Figure  20.  Standard  Deviation  Delta  for  New  Questions 


Rewritten  Questions  Revisited.  To  display  that  the  third  goal  was  met,  Table  9  has  been 
presented.  These  computations  indicate  that  all  the  rewritten  questions  were  headed  toward  the 
same  conclusion  as  the  core  questions.  Note  that  there  was  no  change  in  the  reponses  for  these 
two  questions;  the  experts  simply  did  not  change  their  position.  This  lack  of  change,  along  with 
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the  experience  of  the  core  questions,  indicates  that  responses  for  these  two  questions  would  most 
likely  stay  the  same.  Therefore,  it  can  be  assumed  that  if  these  two  questions  were  reviewed  a 
third  time  by  the  experts,  they  would  have  obtained  consensus  as  defined  in  chapter  three. 


Table  9.  Standard  Deviation  Delta  for  Rewritten  Questions 


SURVEY 

2 

SURVEY 

2 

SURVEY 

3 

SURVEY 

3 

Change  in 

Mean 

Std  Dev 

Mean 

Std  Dev 

Std  Dev 

21 

4.285714 

0.7559 

4.285714 

0.755929 

0.0000 

36 

3.857143 

1.0690 

3.857143 

1.069045 

0.0000 

Additionally,  Figure  21  has  been  provided  to  graphically  display  this  information.  Once  again,  it 
must  be  remembered  that  these  two  questions  were  only  tested  for  two  rounds. 
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Figure  21.  Standard  Deviation  Delta  for  Rewritten  Questions 

Verification  of  the  Research  Model 

As  a  result  of  this  consensus,  those  experts  most  qualified  to  do  so,  verified  the  Research 
Model.  The  three  factors,  along  with  listed  sub  factors,  of  Politics,  Organic,  and  Cost  can  now 
be  considered  the  three  top  factors  a  public  entity  must  allocate  resources  and  managerial  time  in 
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order  to  be  competitive  in  a  public  private  competition.  This  successful  conclusion  of  the  Delphi 
process  has,  therefore  answered  the  first  question  presented  in  chapter  one: 

1.  What  factors  must  a  Public  Entity  allocate  resources  in  order  to  prepare  a 
competitive  proposal  for  a  Public  Private  Competition? 

Content  Development  of  the  Public-Private  Competitive  Assessment  Tool 

The  PCAT  content  was  based  on  the  three,  expert  verified,  key  factors  of  Politics,  Cost,  and 
Organic.  Upon  completion  of  the  PCAT’s  design,  the  content  was  developed,  and  then 
integrated  into  the  tool’s  underlying  Microsoft  Excel  spreadsheet.  The  key  to  this  integration  was 
the  transition  of  Delphi  survey  questions  into  statements  localized  to  the  environment  of 
AR&SC.  This  was  done  at  the  survey’s  item  level.  As  each  item  was  reviewed,  local  titles  and 
concepts,  indigenous  to  the  Coast  Guard  depot,  were  applied  providing  AR&SC  a  customized 
PCAT  product. 

One  at  a  time,  every  item  evaluated  in  Delphi  process  was  carefully  addressed  and 
transitioned  into  the  required  PCAT  content.  As  all  items  in  the  Politics  factor  were  addressed, 
the  Cost  factor  was  then  transitioned  into  customized  PCAT  statements.  This  was  conducted 
until  all  three  Delphi  survey  factors  were  completely  transferred  into  an  aggregate  list  of 
customized  evaluation  points. 

Upon  completion  of  their  development,  the  customized  statements  were  then  integrated  into 
the  PCAT  Excel  spreadsheet.  This  procedure  closely  followed  the  content  flow  used  in  the 
Delphi  survey;  it  was  completed  in  the  exact  order  that  each  factor  and  sub  factor  appeared  in  the 
Delphi  surveys.  As  a  result,  the  managerial  tool  read  similar  to  the  survey  instrument.  One 
benefit  of  this  procedure  was  the  standardization  of  presentation  flows  between  the  Delphi 
survey  format  and  the  PCAT. 
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It  must  be  remembered  that  those  survey  questions  in  the  Delphi  process  were  directly 
representative  of  the  factors  and  sub  factors  making  up  the  Research  Model.  Therefore,  being 
based  on  the  survey  questions,  the  PCAT  content  is  directly  representative  of  that  same  model. 
The  PCAT  instrument,  in  its  entirety,  can  be  found  in  Appendix  D. 

The  POLITICS  Content  of  the  PCAT 

Of  all  the  factors  represented  in  this  tool,  this  section  required  the  most  transitioning  into  local 
aspects.  Every  effort  was  made  to  ensure  that  all  political  arenas,  in  particular  those  even 
remotely  effected  by  possible  depot  outsourcing,  were  included  for  AR&SC  management 
review. 

Mobilization  of  Congressional  Pressures.  The  Delphi  survey  asked  questions  regarding  the 
public  entities  use  of  Turf  Protection  Bureaucrats.  As  defined  in  the  Delphi  process,  Turf 
Protection  Bureaucrats  are  those  politicians  actively  seeking  to  gain  an  advantage  for  themselves 
and  their  constituents.  They  are  best  able  to  publicly  highlight  issues  associated  with  continued 
public  entity  existence.  In  addition  to  Congressional  members,  it  was  also  established  that  state 
and  local  elected  officials  are  members  of  this  same  bureaucracy.  Further,  the  point  was  made 
that  elected  officials,  as  a  whole,  are  primarily  interested  in  protecting  their  district’s  economy, 
infrastructure,  and  financial  worth.  Therefore,  they  are  interested  in  protecting  a  major  public 
entity  if  it  fell  in  their  jurisdiction.  Because  of  these  facts,  it  was  decided  to  base  this  subsection 
on  the  political  awareness  of  politicians  in  regards  to  the  Integrated  Deepwater  Program  threat. 

This  particular  subsection  was  then  further  broken  into  four  areas  representing  Congressional, 
State,  County,  and  Local  political  levels.  In  each  minor  section,  the  same  statement  was  asked  of 
the  AR&SC  manager: 
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Are  the  elected  officials  aware  of  the  potential  Deepwater  Program  outsourcing 
threatening  AR&SC? 

Representatives,  Senators,  and  Governors  of  two  states,  Virginia  and  North  Carolina,  were 
represented  in  this  subsection.  In  addition,  six  North  Carolina  and  two  Virginia  counties  were 
represented,  as  well  as,  the  three  major  communities  of  Elizabeth  City,  NC,  Virginia  Beach,  VA, 
and  Norfolk,  VA.  Lastly,  a  final  statement  was  included  regarding  all  other  local  townships  that 
surround  the  Elizabeth  City  limits. 

Utilization  of  Private  Interest  Groups.  The  next  sub  factor  addressed  the  utilization  of 
private  interest  groups  to  support  the  selection  of  AR&SC  in  a  managed  competition.  As  defined 
in  the  survey,  private  interest  groups  are  politically  motivated  entities  whose  membership  can 
include  organizations  such  as  businesses  and  unions.  In  particular,  the  participation  of  interest 
groups  in  a  public  private  consortium  was  a  key  concept  for  this  study.  In  the  Delphi  process, 
the  public  private  consortium  was  identified  as  a  multimember  organization  able  to  put  forth  a 
stronger  proposal  than  simply  the  single  public  entity. 

The  subsection  was  then  divided  up  into  two  areas  indigenous  to  AR&SC  and  its  relationship 
to  businesses  and  contractors.  These  were  labled  Original  Equipment  Manufactures  (OEMs), 
and  Equipment  Repair  Subcontractors,  and  finally,  other  interest  groups.  OEMs  include  those 
companies  associated  with  airframes,  engines,  and  avionics.  The  statements  included  in  the 
PCAT  asked  two  questions: 

1.  Has  AR&SC  approached  the  particular  OEM 

2.  Has  AR&SC  obtained  agreement  from  the  particular  OEM 
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In  addition  to  the  OEM,  those  same  two  statements  were  asked  in  regards  to  repair 
subcontractors.  These  would  be  the  AR&SC  contractors  charged  with  repairing  sub  components 
such  as  landing  gear  actuators. 

Finally,  the  last  statements  in  this  subsection  referenced  other  interest  groups.  Here,  AR&SC 
managers  were  asked  if  the  labor  unions,  and  state  legislators  had  been  contacted  about 
participating  in  a  competitive  proposal. 

The  COST  Content  of  the  PCAT 

Upon  completion,  the  Cost  Factor  of  the  PCAT  closely  reassembled  the  Cost  Section  of  the 
Delphi  Survey  process.  All  four-sub  factors  from  the  Delphi  Cost  Section  were  included  in  the 
PCAT  section.  Once  again,  the  only  difference  was  the  customization  of  each  statement  toward 
AR&SC  issues. 

The  AR&SC  Cost  System.  The  cost  system  statements  were  all  based  on  Delphi  survey 
questions  from  the  subsection  Applying  a  Managerial  Cost  System.  Although  modified  with 
AR&SC  customization,  the  PCAT  statements  maintained  their  integrity  to  the  original  questions 
asked  in  the  Delphi  process. 

Other  than  minor  grammar  revisions,  the  only  difference  between  the  Delphi  survey  questions 
and  the  PCAT  statements  lay  in  the  use  of  the  term  Activity  Based  Cost  System  (ABC).  Because 
AR&SC  had  already  begun  to  implement  an  ABC  system,  the  term  Cost  System  was  used  at  the 
beginning  of  each  question  in  place  of  Activity  Based  Costing.  For  AR&SC  management,  their 
cost  system  was  an  ABC  system. 

Integrating  a  Cost  System.  This  subsection  measures  the  depth  which  AR&SC  management 
has  avoided  common  mistakes  associated  with  integrating  a  cost  system  into  a  public 
organization.  Once  again,  this  subsection  mirrors  what  was  represented  in  the  Delphi  survey. 
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Use  Consultants  to  help  Integrate  and  Use  a  Cost  System.  AR&SC’s  use  of  outside 
assistance  to  develop  a  competitive  cost  proposal  was  the  issue  being  measured  in  this 
subsection.  As  with  the  previous  subsection,  these  PCAT  statements  closely  followed  the 
questions  from  the  Delphi  survey.  Inclusion  of  the  term  AR&SC  was  the  only  major  difference 
between  the  statements  and  the  survey  questions. 

Reensineer  Processes  to  become  Cost  Competitive.  This  subsection  measured  the  depot’s 
managerial  efforts  to  implement  Business  Process  Reengineering  (BPR)  to  become  cost 
competitive.  There  were  no  content  modifications  made  to  the  Delphi  questions  representing  this 
subsection.  However,  customization  and  minor  grammar  changes  were  completed  to  ensure  the 
format  was  conducive  to  a  localized  assessment  tool. 

Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure.  This  PCAT  subsection 
measured  the  capability  of  AR&SC  management  teams  to  take  competitive  cost  outputs  and 
create  a  competitive  cost  proposal.  As  compared  to  the  Delphi  survey  questions,  there  were  no 
differences  between  them  and  the  PCAT  statements.  Again,  the  statements  did  have  AR&SC 
specific  terms  purposely  integrated  for  tool  customization. 

There  was  a  deletion  of  the  Delphi  survey  item  represented  by  question  #51.  It  was 
determined  that  this  question  would  not  translate  well  into  a  strategic  assessment  tool.  The 
question  went  far  deeper  than  required  into  the  complexities  of  the  Request  for  Proposal  (RFP). 
The  PCAT  did  not  need  to  be  that  microscopic  in  its  assessment  of  established  contracting 
concepts. 

The  ORGANIC  Content  of  the  PCAT 

As  with  the  other  two  factors,  the  Organic  Factor  of  the  PCAT  closely  resembled  the  Organic 
Section  of  the  Delphi  survey. 
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Identification  of  Core  Competencies.  This  particular  section  was  based  on  one  Delphi  survey 
question  referencing  the  value  of  core  competencies  in  a  highly  competitive  environment.  The 
Delphi  question  simply  asked  if  core  competencies,  and  business  practices  based  on  the  core 
competencies,  were  important  to  a  competitive  proposal. 

However,  in  the  PCAT,  this  question  was  further  broken  down  into  two  statements. 

1.  AR&SC  has  identified  its  core  competencies 

2.  AR&SC  management  is  consolidating  its  business  functions  around  these  core 
competencies. 

The  reason  for  this  topic  breakdown  was  to  ensure  that  the  user  team  had,  in  fact,  identified 
the  core  competencies  of  AR&SC.  Unless  AR&SC  can  identify  its  core  competencies,  there  will 
continue  to  be  uncertainty  over  its  business  processes  properly  maximizing  the  organization’s 
inherent  competitiveness. 

Hishlisht  Overhead  and  Excess  Capacity.  This  PCAT  subsection  measures  AR&SC 
management’s  use  of  unused  capacity  in  labor,  facilities,  and  capital.  This  was  included  in  the 
PCAT  to  ensure  that  AR&SC  management  teams  thought  about  the  organic  potential  it  may  have 
presently  within  the  depot  product  lines.  With  the  exception  of  the  customization  factor  for 
AR&SC,  there  were  no  changes  from  the  original  Delphi  survey  questions. 

Utilize  Expertise  and  Corporate  Knowledge.  This  subsection  dealt  with  the  utilization  of 
AR&SC’s  knowledge  of  conducting  depot  maintenance  and  support  of  Coast  Guard  aircraft.  All 
the  PCAT  statements  had  their  origin  in  the  Delphi  survey  questions  based  on  corporate 
knowledge.  For  the  assessment,  three  questions  were  asked  in  regards  to  this  knowledge.  The 
first  inquired  about  the  presence  of  a  system  to  capture  this  data.  The  second  asked  AR&SC  if 
they  had  spoken  with  the  depot  workforce  in  regards  to  capturing  their  specialty  knowledge  base. 
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Finally,  the  third  question  inquired  about  AR&SC’s  position  to  include  this  corporate  knowledge 
in  a  competitive  proposal. 

Hishlieht  Readiness  Capability  of  AR&SC.  This  PC  AT  section  measured  AR&SC’s  ability 
to  promote  its  readiness  capability.  In  this  context,  readiness  was  defined  as  maintaining 
sufficient  internal  capability  (personnel,  equipment,  and  facilities)  to  provide  the  necessary 
technical  competence  and  resources  for  a  timely  response  to  mobilization  or  defense  emergency. 
Based  on  the  Delphi  survey  questions,  three  statements  were  presented  to  the  AR&SC 
management  team.  The  first  asked  about  the  level  of  readiness  advertisement.  The  second 
statement  asked  about  management’s  effort  to  present  the  risks  associated  with  losing  the  depot’s 
product  line  responsiveness.  The  third  statement  simply  asked  if  this  information  was  being 
included  in  a  competitive  proposal. 

Advertise  Reliable  Support  Infrastructure  of  a  Public  Entity.  AR&SC  ’s  ability  to  present 
the  reliability  of  its  support  infrastructure  was  evaluated  in  this  section.  This  would  be  the 
support  infrastructure  as  defined  by  supply  channels,  contractor  relationships,  and  management 
information  systems.  Two  statements,  based  on  the  Delphi  survey  process,  were  included  for 
this  section.  First,  AR&SC  management  was  asked  if  this  support  infrastructure  is  aggressively 
advertised  as  a  low  risk  alternative  to  potentially  cheaper,  private  sponsored  system.  Secondly, 
the  management  was  tasked  to  rate  the  level  of  proposal  integration  of  this  reliability. 

Develop  Public  Performance  Guarantees  to  be  Competitive  in  a  Public  Private  Competition. 
This  is  the  shortest  section  of  the  PC  AT  because  only  one  statement  was  presented  to  the 
AR&SC  management  team.  This  statement  directly  asked  if  AR&SC  expected  to  be  subject  to 
any  downside  financial,  or  contractual  criteria  with  appropriate  penalties.  As  with  all  others,  it 
was  developed  from  a  similarly  named  section  of  the  Delphi  survey.  This  statement  was 
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included  to  explore  the  depot’s  understanding  of  possible  downsides  in  a  public  private 
competition. 

Preparing  a  Competitive  Public  Entity  Proposal  for  a  Public  Private  Competition.  As  the 
final  piece  of  the  PC  AT  instrument,  this  section  inquired  about  AR&SC  management’s  position 
in  reference  to  the  actual  level  of  proposal  preparation.  The  four  statements  presented  were 
taken  directly  from  the  Delphi  survey.  As  with  the  other  statements,  they  were  customized  for 
AR&SC  local  use. 

During  this  stage,  AR&SC  management  was  asked  if  it  recognized  inexperience  as  a 
roadblock  to  developing  a  competitive  proposal.  It  was  then  asked  if  consultants  were  being 
used  to  assist  directly  with  proposal  development.  After  this  statement,  management  was  then 
queried  at  what  level  the  consultants,  if  active  with  AR&SC,  are  assisting  in  proposal 
preparation.  Finally,  a  statement  was  presented  asking  about  the  level  of  participation  in  pre¬ 
proposal  conferences. 

Results  of  the  PC  AT  Beta  Use 

The  results  of  the  PCAT  Beta  Use  were  put  into  a  Microsoft  Excel  spreadsheet.  The  averages 
of  each  of  the  main  factors  and  sub  factors  were  then  computed  to  obtain  a  strategic  overview  of 
the  depot’s  position.  It  was  decided  that  this  was  the  most  conducive  way  to  obtain  a  preparatory 
baseline  due  to  the  limitations  of  the  study.  To  have  each  of  these  PCAT  beta  use  participants 
combine  their  individual  answers  in  a  consensus,  as  per  the  flow  chart,  proved  too  difficult  to 
control  as  a  distant  researcher  and  nonmember  of  the  AR&SC  management  team.  It  was  simply 
easier  to  have  the  individual  participants,  during  their  own  time,  fill  out  the  instrument. 

During  this  alternative  process,  the  participants  were  asked  to  fill  out  the  PCAT  and  then  send 
the  instrument  back  as  an  electronic  mail  attachment.  The  individual  responses  were  then  input 
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into  the  spreadsheet  programmed  to  obtain  a  group  average  for  each  factor  and  sub  factor.  Once 
computed,  this  data  was  then  reviewed  to  obtain  the  baseline  assessment  of  AR&SC’s  position 
for  participation  in  a  public  private  competition.  Table  10.  presents  an  example  of  this  raw  data 
collection  spreadsheet. 


Table  10.  Example  PCAT  Beta  Use  Data  Sheet 


AR&SC  Management 

1 

2 

ii 

POLITICS  FACTOR 

1.2 

2.4 

ii 

CO 

1.1  Mobilization  of  ELECTED  Officials 

1.4 

1.8 

ii 

1.6 

1.2  Utilization  of  Private  Interest  Groups 

1.0 

3.0 

ii 

2.0 

U  U  it  it 

AR&SC  Management  Particii 

it 

pants 

U  U  ((  (C 

Sum  # 

Position 

Rank 

1 

Commanding  Officer 

0-6 

2 

Executive  Officer 
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Again,  it  must  be  noted  that  an  AR&SC  management  team  would  normally  take  the  PCAT 
tool  as  individuals.  As  previously  mentioned,  the  group  would  then  meet  to  obtain  a  consensus 
answer  for  each  factor  and  sub  factor.  The  fact  that  this  study  utilized  an  Excel  spreadsheet  to 
compute  averages  is  indigenous  only  to  this  study;  this  spreadsheet  was  merely  simulating  the 
consensus  portion  of  the  PCAT  instrument  flow.  In  the  real  managerial  world,  it  would  be  left 
up  to  the  AR&SC  team  members  on  how  they  would  best  obtain  consensus.  The  AR&SC 
management  team  should  feel  free  to  develop  their  own  methodology  according  to  the 
capabilities  and  needs  of  the  membership. 

The  results  of  the  PCAT  Beta  Use  are  summarized  in  Table  1 1  for  review.  This  summary 
sheet  is  representative  of  what  the  AR&SC  management  team  would  produce  upon  completion 
of  the  PCAT  assessment.  As  stated  in  chapter  three,  it  is  this  sheet  which  would  provide  the 
strategic  direction  for  eventual  placement  of  resources. 
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Table  11.  Summary  of  AR&SC  Baseline  Evaluation 

SUMMARY  OF  AR&SC  COMPETITIVE  EVALUATION 


POLITICS  FACTOR 

1.1  Mobilization  of  ELECTED  Officials 

1.2  Utilization  of  Private  Interest  Groups 


COST  FACTOR 

2.1  Applying  a  Managerial  Cost  System 

2.2  Integrating  a  Cost  System 

2.3  Reengineer  Processes  to  Become  Cost  Competitive 

2.4  Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 


ORGANIC  FACTOR 

3.1  Identification  of  Core  Competencies 

3.2  Highlight  Overhead  and  Excess  Capacity 

3.3  Utilize  Expertise  and  Corporate  Knowledge 

3.4  Highlight  Readiness  Capability  of  the  Public  Entity 

3.5  Advertise  Reliable  Support  Infrastructure  of  a  Public  Entity 

3.6  Develop  Public  Performance  Guarantees  to  be  Competitive  in  a  Public  Private 
Competition 

3.7  Preparing  a  Competitive  Public  Entity  Proposal  for  a  Public  Private 
Competition 


The  High  Level  Baseline  Review  of  AR&SC 

Politics  Baseline.  The  Politics  factor  has  distinguished  itself  as  being  the  lowest  scoring 
factor  of  the  three  in  this  initial  assessment  of  AR&SC.  With  an  average  score  of  2.0,  this  area 
demands  the  attention  of  the  AR&SC  management.  Highlighted  is  the  lack  of  contact  with  key 
interest  groups  which,  according  to  this  study’s  Research  model,  is  a  major  factor  in  the 
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competitiveness  of  the  public  entity.  The  beneficial  fact  about  this  entire  section,  however,  is 
that  it  can  be  improved  though  simply  an  investment  in  time  on  the  part  of  management.  In  other 
words,  the  only  cost  to  AR&SC  would  be  the  time  required  to  conduct  presentations  to  the 
political  entities  most  beneficial  of  AR&SC’s  continued  operation. 

Whether  AR&SC  management  wants  to  further  investigate  this  factor’s  PC  AT  data  and  invest 
the  necessary  resource  is  left  up  entirely  to  their  decision.  However,  there  must  be  no  avoiding 
the  importance  and  potential  benefit  of  having  political  horsepower  working  as  an  ally  of  the 
depot  in  a  public  private  competition.  Being  attentive  to  politics  is  an  easy  way  to  improve  the 
organization’s  competitive  position.  Properly  recruited  with  key  information,  politicians  could 
be  considered  maintenance  free  defenders  of  the  AR&SC  organization. 

Cost  Baseline.  This  factor  obtained  the  highest  PCAT  rating  for  Beta  Use.  The  reason  is 
particularly  simple  in  explanation.  Through  unsolicited  PCAT  feedback,  AR&SC  management 
admitted  it  was  in  the  process  of  integrating  an  Activity  Based  Cost  (ABC)  System.  Though  still 
in  the  early  stages,  the  system  is  being  employed  to  capture  cost  information  and  map  overhead 
allocation  to  airframe  resources.  This  is  why  the  overall  factor  has  a  rating  of  3.5;  it  is  accurately 
reflecting  this  early  ABC  integration  effort.  Clearly,  the  highly  rated  sub  factor  of  cost 
integration  was  the  key. 

The  other  sub  factor  ratings  suggest  that  there  is  more  to  this  story.  Looking  at  sub  factors  2. 1 
and  2.3,  each  one  is  hovering  close  to,  yet  above,  the  critical  value  of  3.0.  This  indicates  there  is 
much  room  for  improvement  in  areas  of  cost  system  application  and  process  reengineering.  It 
would  be  to  the  benefit  of  AR&SC  management  to  investigate  these  areas  for  further 
improvement.  One  area  in  particular  would  be  ensuring  this  ABC  system  integration  takes  into 
consideration  these  other  sub  factors.  For  example,  a  cost  effective  organization  is  one  that  can 
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identify  high  cost  areas  (ABC)  and  take  proper  measures  (possibly  reengineer)  to  decrease  this 
excessive  cost.  AR&SC  management  must  remember  that  these  cost  sub  factors  all  relate  to  one 
another. 

The  lowest  scoring  sub  factor  measured  the  use  of  cost  information  in  proposal  preparation. 
This  was  the  expected  initial  response  due  to  a  known  Coast  Guard  unfamiliarity  with  public 
private  competition  concepts.  As  the  preparation  process  continues,  this  factor  will  become 
more  and  more  important  to  AR&SC’s  success  in  a  managed  competition  The  introduction  of 
this  sub  factor  simply  provides  AR&SC  management  teams  with  a  new  topic  to  further  research 
and  dedicate  resources. 

Overall,  this  factor  assessment  presents  AR&SC  as  having  to  improve  in  several  areas  before 
being  cost  competitive  in  a  public  private  competition.  It  is  interesting  to  note  that,  with  the 
exception  of  sub  factor  2.4,  these  mid  level  scores  mirror  an  organization  early  in  a  cost  system 
implementation.  This  fact  verifies  that  data  coming  from  the  PCAT  instrument  is  reflective  of  an 
organizations  actual  position. 

The  initial  strategic  assessment  for  cost  is  extremely  encouraging.  Because  AR&SC  is 
moving  in  the  direction  of  ABC  cost  management,  it  is  expected  that  the  Cost  factor  will 
continue  to  score  higher  with  time. 

Organic  Baseline,  This  factor  was  the  second  highest  scoring  Research  model  factor.  This 
reflects  that  AR&SC  management  is  addressing  the  Organic  sub  factors.  However,  as  with  the 
previous  factors,  the  resulting  scores  are  just  above  the  critical  value  3.0.  This  indicates  room  for 
improvement  to  be  organizationally  competitive.  Of  particular  interest  is  AR&SC’s  position  in 
regards  to  Core  Competencies. 
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The  strongest  sub  factor  measured  the  identification  of  Core  Competencies.  It  is  clear  from 
all  AR&SC  respondents  that  this  was  not  a  new  topic.  In  other  words,  the  scores  imply  that 
AR&SC  has  a  good  grasp  on  the  concept  of  core  competencies.  Additionally,  this  indicates  that 
management  has  organized  business  process  around  these  identified  core  competencies.  Of 
particular  interest  to  this  study  is  that  fact  these  core  competencies  have  been  verified  by  private 
industry.  Through  research  contact  with  AR&SC  management,  it  has  been  learned  that  private 
industry  representatives  have  visited  AR&SC  to  study  how  it  uses  an  integrated  product  lines 
concept  to  depot  Coast  Guard  aircraft;  this  is  a  systems  approach  to  maintenance  that  integrates 
supply  function,  operational  functions,  and  maintenance  functions.  The  bottom  line  is  that 
AR&SC  management  is  positioned  well  and  very  competitive  in  this  sector. 

Of  interest  to  this  evaluation  is  the  sub  factor  of  3.2,  highlighting  excess  capacities.  During 
the  Delphi  process,  expert  feedback  indicated  that  excess  capacities  are  commonly  thought  of  as 
competitive  liabilities.  This  was  because  active  excess  capacity  in  any  area  generally  indicates  a 
poorly  managed,  non-competitive  organization.  The  experts  did  admit  that,  in  the  short  run  as 
part  of  a  competitive  preparation  effort,  this  excess  capacity  could  become  a  competitive 
advantage.  It  is  arguable  that,  during  a  managed  competition,  the  government  could  be 
convinced  it  made  sense  to  ensure  the  complete  utilization  of  already  owned  public  facilities.  In 
general,  the  response  of  AR&SC  management  presents  this  attitude.  The  fact  that  the  score  is 
above  the  3.0  critical  mark  indicates  AR&SC  management  simply  needs  to  further  explore  its 
excess  capacity  to  take  advantage  of  its  competitive  potential. 

Corporate  knowledge  was  another  average  scoring  concept  for  AR&SC.  It  is  well  known  in 
Coast  Guard  aviation  that  the  workforce  of  AR&SC  contains  a  comprehensive  tacit  knowledge 
base  of  aircraft  maintenance.  Although  the  military  management  routinely  changes,  the  civilian 
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workforce  stays  the  same.  This  is  a  benefit.  In  some  AR&SC  product  lines,  some  workers  have 
maintained  aircraft  since  they  were  first  introduced  into  service  use.  A  perfect  example  is  the 
Eurocopter  HH-65A  Dolphin  helicopter  program.  Although  the  backbone  of  Coast  Guard 
aviation  today,  this  aircraft  has  led  a  twenty  year  service  life  with  its  own  list  of  trouble  areas 
with  appropriate  fixes.  Because  of  workforce  stability,  there  are  some  AR&SC  members  whom 
have  seen  all  of  these  issues.  This  type  of  knowledge  cannot  be  duplicated  by  a  competing 
private  corporation.  Therefore,  it  is  a  good  idea  for  AR&SC  management  to  aggressively  capture 
this  knowledge  and  present  it  as  a  competitive  asset.  The  PCAT  information  indicates  AR&SC 
has  room  for  improvement  in  this  area. 

As  far  as  highlighting  the  readiness  aspect  of  AR&SC,  the  management  team  provided  more 
middle  of  the  road  answers  here  as  well.  The  AR&SC  readiness  capability  is  very  visible  to  the 
operational  user  whom  is  the  key  customer  of  AR&SC.  Due  to  the  nature  of  Coast  Guard 
aviation,  the  need  to  have  finely  tuned  logistics  channels  and  procedures  is  a  necessity  for  search 
and  rescue  (SAR)  operations.  Without  it,  aviation  response  may  not  be  successful  resulting  in 
conceivable  humanitarian  catastrophes. 

AR&SC  does  a  truly  superior  job  at  readiness;  however,  it  does  a  mediocre  job  of  advertising 
this  strength  to  those  whose  opinion  can  possibly  sway  the  outcome  of  a  managed  competition. 
Having  the  parts  and  support  at  the  right  place,  the  right  time,  in  the  right  amount  is  the  only  way 
aging  Coast  Guard  airframes  can  remain  SAR  ready  twenty  four  hours  a  day,  seven  days  a  week, 
52  weeks  a  year.  Because  the  assessment  assumes  this,  the  PCAT  statements  are  more  oriented 
toward  measuring  the  level  of  advertisement  of  these  strengths.  Once  again,  this  strength  is  very 
hard  to  duplicate  in  private  industry  without  paying  a  lot  for  the  service.  AR&SC  needs  to 
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ensure  that  this  strength  is  highlighted  in  any  future  competitive  proposal.  Just  as  in  politics, 
AR&SC  management  simply  has  to  expend  the  time. 

Dovetailing  into  this  subject  of  readiness,  AR&SC  management  was  asked  about  highlighting 
the  lower  risks  associated  with  keeping  a  successful  public  support  infrastructure  vice  switching 
to  an  unproven  private  contract.  It  is  extremely  important  that  an  organization,  such  as  AR&SC, 
proactively  advertise  the  competitor  downsides  to  make  more  visible  the  public  entity  strengths. 
This  is  the  exact  information  that  should  be  provided  to  politicians  and  private  interest  groups 
such  as  those  mentioned  earlier  in  this  section.  Because  AR&SC  scored  close  to  the  critical 
factor  of  3.0,  it  can  be  assumed  that  this  advertisement  was  only  being  considered  and  not 
aggressively  pursued.  Once  again,  this  would  cost  AR&SC  nothing  but  time  to  increase  the 
score  and  its  competitiveness  in  this  sub  factor. 

The  next  statement  considered  AR&SC  expectations  in  regards  to  the  risk  of  downside 
penalties  in  a  public  private  competition.  This  was  the  lowest  scoring  area  in  the  PCAT  Beta 
Use;  it  fully  indicates  that  AR&SC  management  must  address  this  area  of  contracting  concepts. 
Unless  they  accomplish  all  work  according  to  the  letter  of  the  contract,  AR&SC  must  completely 
understand  they  will  be  subject  to  penalties  such  as  operating  budget  decreases  or  loss  of  future 
bidding  opportunities  It  is  important  that  the  organization  ensures  its  procedures  and  corporate 
attitude  properly  reflect  this  downside  potential.  In  other  words,  the  workforce  should  be  finely 
tuned  to  complete  the  work  assignments  without  having  to  suffer  penalties  prior  to  competing.. 
This  is  not  particularly  crucial  in  the  first  competition,  but  extremely  important  during  the 
conduct  of  the  contract  workloads.  It  must  be  assumed  that  private  competitors  will  not 
disappear  from  the  market;  they  will  be  there  bidding  against  AR&SC  for  future  workloads.  To 
continue  operation,  AR&SC  must  ensure  that  it  is  competitive  during  and  after  the  competitions. 
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Finally,  AR&SC  was  measured  to  obtain  a  baseline  of  proposal  preparation.  This  section 
feedback  resulted  in  a  critical  value  of  3.0.  Although  low,  this  was  an  expected  result.  Presently, 
the  Integrated  Deepwater  System  (IDS)  is  still  on  the  horizon,  and  it’s  exact  relationship  with 
Coast  Guard  support  facilities  remains  in  question.  However,  this  study  has  operated  on  a  very 
plausible  assumption;  IDS  will  aggressively  seek  to  disassemble  AR&SC  through  piecemeal 
outsourcing  of  its  product  line  workloads. 

Clearly,  it  is  in  AR&SC ’s  best  interest  to  begin  the  process  of  competition  preparation.  It 
should  aggressively  attend  all  Deepwater  pre-proposal  conferences  to  listen,  learn,  and  ask 
questions;  this  should  be  done  with  the  express  goal  of  obtaining  competitive  advantage. 
Additionally,  the  use  of  consultants  needs  to  be  further  investigated  to  specifically  assist  with 
preparation  of  proposal  inputs  and  competition  preparations.  AR&SC  must  recognize  that  it 
does  not  have  all  the  expertise  to  do  this  alone. 

Public  private  competitions  are  a  recent  phenomenon  for  government  entities;  however, 
government  bidding  is  an  age-old  practice  for  private  corporations.  The  sooner  AR&SC 
understands  it  is  does  not  have  the  upper  hand  nor  experience  in  large  scale  contract 
competitions,  the  better  for  the  organization.  What  AR&SC  does  have  is  an  extremely 
successful  aircraft  repair  and  supply  center  deserving  of  a  chance  to  compete  and  win  a  contract 
award.  AR&SC  can  be  extremely  competitive,  but  only  if  it  conducts  preparations  ahead  of 
time.  The  time  for  preparation  is  now  while  the  IDS  program  is  still  in  its  infancy.  This  Beta 
utilization  of  the  PC  AT  is  only  AR&SC  management’s  first  step  toward  a  well-planned,  highly 
competitive  workload  proposal. 
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Final  Thoughts  on  the  Strategic  Baseline  Results 

This  strategic  baseline,  and  the  datum  obtained  from  the  PCAT,  serves  to  answer  the  second 
question  to  this  study: 

What  is  the  Aircraft  Repair  and  Supply  Center’s  overall  position  in  addressing  these  key 

factors  to  create  a  competitive  public  proposal  for  a  managed  competition? 

From  the  outset  of  the  study,  this  baseline  was  meant  to  provide  a  high  level  snapshot  of 
AR&SC’s  competitive  position.  Although  clearly  available  for  review,  the  study  did  not  want  to 
delve  too  deeply  into  the  lower  level  assessment  data  also  available  by  the  PCAT.  As  a 
researcher,  there  was  a  clear  temptation  to  study  the  item  level  scores  and  provide  preparatory 
recommendations  to  AR&SC  management.  Flowever,  it  was  decided  this  might  come  across  as 
unqualified  and  unsuitable  due  to  the  researchers  position  as  an  outsider.  The  key  to  successful 
PCAT  use  is  the  depot’s  management  team.  AR&SC  process  owners  are  the  only  ones  able  to 
effectively  apply  all  the  information  provided  by  the  PCAT. 

This  is  where  the  PCAT  instrument  comes  into  focus.  This  tool  has  become  a  truly  useful 
product  of  this  thesis  effort.  The  potential  to  obtain  worthwhile,  real  time  competitive 
assessment  data  is  unlimited.  The  value  of  the  PCAT  is  in  its  ability  to  provide  a  variance  within 
each  major  factor;  this  is  done  through  the  evaluation  and  presentation  of  sub  factors.  The  PCAT 
simply  has  to  be  used  by  AR&SC  management  as  it  was  designed:  as  a  quick,  iterative  strategic 
compass  for  public  private  competition  preparation. 
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V.  Summary  Discussion 


Introduction 

This  chapter  is  presented  with  the  express  goal  of  providing  a  strategic,  high  altitude  summary 
of  this  research  product  In  addition  to  a  summary,  there  will  be  a  discussion  on  the  study’s 
limitations  and  its  potential  for  use  in  other  areas.  Finally,  a  discussion  will  take  place 
recommending  areas  for  follow-on  research. 

Background 

The  sponsor  of  this  research  is  the  U.S.  Coast  Guard  Aircraft  Repair  and  Supply  Center 
(AR&SC)  located  at  Elizabeth  City,  North  Carolina.  This  center’s  mission  is  to  depot 
maintenance  Coast  Guard  aircraft  and  helicopters,  support  the  airframes  through  an  extensive 
parts  supply  infrastructure,  and  engineer  aircraft  modifications  necessary  for  upgraded 
operations.  AR&SC’s  customers  include  U.S.  Coast  Guard  air  stations,  the  U.S.  Navy,  and  the 
U.S.  Air  Force. 

To  cut  support  costs  and  modernize  assets,  the  U.S.  Coast  Guard  initiated  the  largest 
acquisition  program  in  its  history.  Called  the  Integrated  Deepwater  System  or  IDS,  it  is  designed 
to  be  a  system  of  systems  approach  integrating  surface,  land,  and  air  assets  of  the  service.  Once 
awarded,  the  IDS  program  will  partner  with  a  world  class  Systems  Integration  and  Management 
Contractor  to  design,  construct,  deploy,  operate,  support  and  dispose  of  this  system  of  systems. 
The  Coast  Guard  will  be  responsible  for  managing  operational  requirements,  responding  to 
mission  demands  and  environment  changes,  and  operating  the  system;  the  IDS  Contractor  will  be 
responsible  for  designing  and  constructing  the  system,  as  well  as,  sharing  responsibility  for 
supporting  and  disposing  of  it. 
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Because  the  IDS  program  is  still  in  its  infancy,  this  study  is  operating  on  a  very  plausible 
premise  that  the  IDS  will  aggressively  seek  to  disassemble  AR&SC  through  piecemeal 
outsourcing  of  its  product  line  workloads.  As  a  defensive  strategy  to  this  IDS  philosophy  of 
reducing  ownership  costs,  AR&SC  must  ensure  that  its  streamlined,  cost  effective  public 
organization  is  prepared  to  participate  as  a  highly  competitive  team  in  any  potential  public- 
private  competition  for  aircraft  depot  workloads.  It  is  the  hope  that  the  thesis  effort  will  assist 
AR&SC  in  this  endeavor. 

Research  Question 

There  were  two  research  goals  for  this  thesis.  The  first  was  identification  of  key  factors  a 
generic  public  entity  needs  to  address  to  be  competitive  in  a  public  private  competition.  The 
second  was  the  establishment  of  an  overall  competitive  position  of  AR&SC.  These  two  goals 
were  transitioned  into  the  following  research  questions: 

1.  What  factors  must  a  Public  Entity  allocate  resources  in  order  to  prepare  a  competitive 
proposal  for  a  Public  Private  Competition? 

2.  What  is  the  Aircraft  Repair  and  Supply  Center’s  overall  position  in  addressing  these  key 
factors  to  create  a  competitive  public  proposal  for  a  managed  competition? 

Summary  of  the  Overall  Study 

From  extensive  literary  research,  a  Research  Model  was  built  utilizing  identified  factors  of 
Politics,  Cost,  and  Organics.  This  model  was  then  verified  through  a  Delphi  survey  process. 
The  selected  respondents  for  the  surveys  were  experts  representing  academia,  commercial 
industry,  and  government.  The  Delphi  process  resulted  in  a  consensus  amongst  the  experts  that 
the  key  factors  were  in  fact  Politics,  Cost,  and  Organic.  This  answered  the  first  research 
question. 
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Once  verified,  the  factors  and  sub  factors  were  transitioned  into  an  assessment  tool 
customized  for  use  by  AR&SC  management  teams.  Called  the  Public  Private  Competitive 
Assessment  Model  or  PCAT,  this  tool  was  designed  for  use  as  an  iterative  preparatory  planning 
tool  for  management  teams.  The  PCAT  was  beta  used  with  selected  AR&SC  management 
members  to  gain  an  initial  data  set.  Once  completed,  the  PCAT  datum  was  developed  into  a 
baseline  of  AR&SC ’s  competitive  position.  This  answered  the  second  research  question. 

Discussion  of  the  Delphi  Technique 

One  of  the  most  extensive  parts  of  this  thesis  study  was  the  utilization  of  the  Delphi  technique 
to  provide  verification  of  the  Research  Model.  Although  very  straight  forward  in  its  concept,  the 
technique  required  more  coordination  and  groundwork  than  had  been  originally  anticipated  in  the 
research  planning.  For  example,  it  took  almost  three  weeks  to  research,  contact,  and  sign  up 
experts  in  the  field  of  public  private  competition. 

Each  expert  was  personally  contacted  via  telephone  and  provided  a  briefing  on  the  thesis 
effort.  This  proved  to  be  challenging  because  most  of  the  experts,  due  to  their  high  level 
positions,  were  very  constrained  by  time  limitations  and  workload.  Sometimes,  these  briefings 
took  place  on  the  expert’s  cell  phone  as  they  drove  home  from  offices  in  Washington,  DC.  It 
must  be  noted,  however,  that  during  the  Delphi  process,  all  the  experts  proved  extremely 
agreeable  and  truly  excited  about  expressing  their  views  on  this  controversial  subject.  This  level 
of  cooperation  proved  to  be  strength  of  the  study.  Each  participant  had  definitive  views  on  the 
topics  and,  in  particular,  enjoyed  providing  them  via  the  open  feedback  portions  of  the  survey. 
This  excitement  and  self-motivation  was  the  key  to  the  study’s  low  respondent  casualty  rate. 

The  Delphi  surveys  also  proved  to  be  a  challenge.  The  first  survey  was  a  very  straightforward 
development  effort.  It  was  simply  created  from  the  Research  model  research  and  then  sent  to  the 
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experts  for  their  review.  The  challenge  came  from  expert  written  feedback  obtained  through  the 
open-ended  questions.  The  amount  and  quality  of  this  feedback  was  completely  unexpected  to 
the  researcher.  Although  plans  were  in  place  to  capture  and  review  written  survey  feedback,  the 
procedures  did  not  anticipate  the  sheer  amount,  as  well  as,  continuous  quality  of  the  feedback. 
Almost  every  comment  had  something  to  contribute  to  the  study;  there  was  never  any  complaints 
or  professional  ramblings.  As  a  result.  Excel  spreadsheets  were  reprogrammed  to  capture  this 
data  and  sort  it  according  to  topic.  Once  the  topic  sorts  were  completed,  the  data  could  be  sorted 
for  repeated  subjects  and  finally  developed  into  a  possible  new  idea  or  question  for  the  next 
survey  iteration. 

Finally,  it  must  be  stated  that  the  Delphi  process  was  a  very  time  consuming  procedure. 
Although  the  entire  process  was  completed  in  one  month,  this  month  required  daily  maintenance 
of  the  study  effort.  During  this  crucial  period,  not  one  day  went  by  which  was  free  for  other 
aspects  of  the  thesis;  there  was  always  some  part  of  the  Delphi  to  monitor  or  complete.  Tasks 
ranged  from  data  collection  to  making  reminder  phone  calls  to  experts,  whom,  although 
participating,  were  very  focused  on  their  jobs.  They  simply  required  a  memory  jog  for  survey 
completion. 

Discussion  of  the  PCAT 

This  proved  to  be  just  as  complicated  as  the  Delphi  effort,  yet  less  constrained  in  its 
development  and  utilization.  The  development  of  the  PCAT  instrument  was  an  exercise  in 
motivation,  adaptability  of  information,  and  utilization  of  past  managerial  experience. 

Each  of  these  issues  will  be  briefly  touched  upon  for  review. 

The  motivation  to  develop  the  PCAT  instrument  was  simply  not  driven  by  an  academic 
requirement.  It  was  completely  based  on  the  desire  to  fulfill  a  need  within  the  Coast  Guard  naval 
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aviation.  With  the  advent  of  the  IDS  program,  there  appears  to  be  an  ingrained  philosophy  that 
service  support  entities  are  ineffective  to  operate  and  not  conducive  to  the  future  of  the  Coast 
Guard.  Clearly  from  this  study’s  analysis,  this  philosophy  is  untrue.  With  proper  competitive 
preparation,  AR&SC  can  prove  this  in  a  public  private  competition  for  aviation  workloads. 

Adaptability  of  information  was  key  to  development  of  the  PCAT.  The  goal  was  to  give 
AR&SC  a  tool  that  provided  utility,  yet  provided  it  in  a  manner  reflective  of  the  Research  model. 
Although  a  lengthy  process,  it  took  only  a  fraction  of  the  time  used  in  the  Delphi  survey 
preparation.  The  greatest  challenge  to  this  adaptability  was  the  customization  of  each  key  factor 
and  sub  factors  to  the  needs  of  AR&SC  management.  This  required  the  expertise  of  an  AR&SC 
team  member  to  ensure  proper  terms  and  concepts  were  actively  being  used  on  the  management 
team. 

The  integration  of  past  managerial  experience  proved  to  be  strength  in  the  PCAT 
development.  This  past  experience  was  completely  reflected  in  the  tool’s  design  and  procedural 
flow.  It  was  known  the  PCAT  would  not  be  integrated  into  daily  use  if  proven  difficult  and 
complicated  to  the  user.  Additionally,  the  PCAT’s  data  output  had  to  be  in  a  format  conducive 
to  quick,  easily  understood  summaries.  It  was  decided  that  these  two  aspects  of  the  instrument 
were  required;  therefore,  they  became  the  baseline  constraints  for  the  PCAT  mechanical  design. 
The  result  was  an  easy  to  use,  non-threatening  instrument  capable  of  providing  simple,  effective 
feedback. 

Limitations  of  this  Thesis  Effort 

There  was  only  one  limitation  to  this  thesis  effort.  There  was  simply  not  enough  time  to  do 
the  study  as  had  been  planned  in  the  beginning.  For  example,  a  second  consensus  methodology 
was  in  the  planning  stages  but  was  deleted  due  to  timeline  constraints  of  the  AF1T  program. 
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Although  not  required  to  determine  the  consensus  of  the  experts,  it  would  have  been 
academically  pleasing  if  two  different  methods  were  deployed  to  show  the  same  result. 

Time  was  also  a  constraint  in  the  development  of  the  PC  AT  instrument.  During  planning  for 
this  thesis  effort,  the  PCAT  was  to  be  deployed  multiple  times  instead  of  simply  once  with 
AR&SC  management.  It  had  been  hoped  that  the  PCAT  could  be  implemented  into  the  daily 
workload  of  AR&SC  management.  This  implementation  would  have  included  the  development 
and  use  of  an  AR&SC  management  Quality  Action  Team  (QAT).  Through  this  effort,  it  was 
anticipated  the  PCAT  could  have  become  a  permanent  part  of  AR&SC,  as  well  as,  begin  the 
process  of  competitive  preparation.  For  now,  it  will  be  left  up  to  AR&SC  to  properly  integrate 
the  PCAT  on  its  own  schedule. 

Discussion  of  Alternative  Uses  for  Research 

There  should  be  no  mistaking  the  goals  of  the  Integrated  Deepwater  System;  it  is  a  threat  to 
the  traditional  Coast  Guard  infrastructure.  Because  of  this  fact,  this  research  is  completely 
applicable  to  the  service’s  remaining  depots  and  support  facilities  such  as  the  Coast  Guard 
Shipyard  in  Curtis  Bay,  Maryland.  However,  the  PCAT  and  its  concepts  are  completely  not 
limited  to  the  Coast  Guard. 

An  interesting  fact  of  the  PCAT  is  its  ability  to  be  modified  for  use  in  any  public  organization 
in  danger  of  outsourcing.  Because  it  is  based  on  key  factors  of  a  generic  public  entity,  the  PCAT 
can  be  considered  a  generic  template.  It  just  happens  the  PCAT  in  this  study  was  customized  for 
AR&SC.  In  fact,  with  appropriate  customization,  the  PCAT  could  very  well  be  employed  at  the 
Air  Force  Institute  of  Technology. 
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Follow-on  Research 


As  mentioned  earlier,  one  area  for  research  is  the  continued  integration  of  the  PCAT 
instrument  into  a  government  organization.  This  PCAT  implementation  would  include  the 
formation  and  cooperation  of  a  management  team  to  conduct  preparations  for  a  public  private 
competition.  The  overall  goal  would  be  to  further  prove  the  usefulness  of  the  PCAT  as  a 
managerial  instrument.  A  second  goal  would  be  to  document  how  the  public  entity  would  pursue 
this  preparation  given  its  resource  availability.  It  must  be  remembered  that  the  PCAT  was 
designed  to  provide  strategic  direction;  it  does  not  provide  feedback  in  the  form  of  tactical 
decisions.  This  is  a  function  of  the  organizations  management. 

Conclusion 

Public  private  competition  is  a  concept  with  growing  popularity  in  the  United  States  and 
overseas.  With  the  ever-shrinking  budgets  and  the  popularity  of  finding  new  ways  to  do  better 
business,  public  organizations  can  no  longer  afford  to  be  blind  to  the  threat  from  private 
corporations;  the  result  could  be  catastrophic  for  the  pubic  entity  and  its  workforce,  in  this 
study,  it  has  been  established  that  public  entities,  on  the  whole,  do  not  have  same  level  the 
business  experience  as  potential  private  competitors.  This  translates  into  a  handicap  for  the 
public  organization  in  a  competition  for  workloads.  Clearly,  it  is  left  up  to  the  public 
organization  to  decide  if  it  wants  to  prepare  for  competition  or  if  it  seeks  to  risk  disestablishment. 

This  thesis  has  provided  the  public  entity  with  a  study  and  tool  for  this  purpose.  It  is  hoped 
that  public  organizations  will  use  this  thesis  to  further  build  upon  their  own  raw  competitive 
foundations. 
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Appendix  A:  Survey  One  and  Cover  Letter 


This  is  a  copy  of  the  very  first  survey  sent  out  to  the  Delphi  experts.  It  consists  of 
information  based  strictly  on  the  literary  research  and  Research  Model.  The  Cover  Letter 
and  Survey  One  were  both  sent  to  each  expert  as  electronic  mail  attachments. 
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30  Oct  01 


Subject:  Public  Private  Competition  Survey 
Hello  All, 

Thank  you  very  much  for  contributing  to  this  research.  This  study  explores  the  key 
factors  which  would  enable  a  public  offeror  to  be  competitive  in  a  public  private 
competition.  Simply,  1  am  looking  to  identify  the  most  important  factors  a  public  team 
would  need  to  devote  resources  in  preparation  for  a  competition  against  private  offerors. 

From  my  research,  1  have  been  able  to  develop  a  causal  model  which  represents  some 
of  these  key  factors;  however,  a  validation  of  these  key  factors  is  required.  This  is  where 
your  expertise  comes  in  to  play.  It  is  hoped  that  through  direct  contact  by  survey,  you 
and  other  subject  experts  can  assist  in  validating  and  improving  upon  this  model. 

To  accomplish  this,  there  will  be  a  series  of  three  surveys.  This  first  survey  consists 
of  74  questions.  The  questions  are  grouped  under  three  main  factors  identified  thus  far: 
Organic,  Politics,  and  Cost.  A  scale  between  1  and  5  is  used  to  describe  the  level  of 
agreement  with  each  statement.  Please  ensure  that  you  read  the  first  page  of  the  survey; 
this  gives  you  a  more  detailed  description  of  the  number  scale,  as  well  as,  some  key 
definitions  used  throughout  the  instrument  itself. 

Please  complete  the  survey  as  a  word  document  using  the  highlight  function  to  identify 
you  choice.  You  will  notice  there  are  areas  for  comments  after  each  question  and  after 
each  section.  Please  feel  free  to  include  any  thoughts  that  would  further  the 
understanding  of  the  particular  statement,  subject,  or  introduce  a  new  factor  not 
mentioned. 

Upon  completion,  please  rename  the  document  with  your  name  included  in  the  title: 

YOURNAMEsurveyl 

Then  just  simply  email  it  back  to  me  as  an  attachment.  Timothy.Gifbride@afit.edu 

if  you  choose,  you  can  mail  the  survey  to: 

AFIT/ENV  BLDG  640 
2950  P  STREET 

WRIGHT  PATTERSON  AFB  OH  45433-7765 
ATTN:  LCDR  Gilbride,  U.S.  Coast  Guard 

If  you  have  any  questions,  feel  free  to  contact  me  at  (937)  236-0212  (h)  or  via  email. 
Sincerely, 

Timothy  J.  Gilbride,  LCDR,  USCG 
Graduate  Student,  AFIT 


127 


For  each  question,  please  highlight  the  number  that  best  describes  your  level  of  agreement. 
Rate  between  1  and  5 
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jr  .ts 

£0  g 

"fa  Oh 

'ab  E 

3  8 


as  CD 
O  Q. 

^  S  co 
o  8  §- 
8 
o 

^  I  o 

CD 

flJ 

w  >  5 
co  5  s 

-O  ®  ^ 

-fa  7-HH  -fa 


R  R 
.N  R 
-R  cu 

•3  ^ 

2  s? 


-s  c3 

J  s 

O 

R  <£r 
•2  P 

g  cj 

%  2 
"$  <5 
s  r  - 


^  F  CD 

CD  <5  o 

r-  «K«i  S- ' 

fc  .S  a 


h— * 

■a  cj 
a>  o< 
tJ  E 

bl)  O 
fa  o 
*3  5j 

..  >>  fa 

co  —  > 

g  g  -c 
E  3  5 

111 

u  £  & 


o 

■4—* 

t/) 

G 

G- i 

G 

+-> * 

* 

*4-» 

a 

OJ 

£ 

CJ 

o 

g 

X> 

o 

a 

o 

Ou 

<D 

03 

(Z) 

&D 

G 

<D 

5-h 

*o 

G 

5-h 

a 

O 

o 

<D 

t/3 

-4— > 

a 

a 

O 

ga 

(D 

c/T 

-G 

a 

o 

G 

-§  8 

's  >> 

g  fai  | 
g  fa  « 

(D  E/5  N 

g  “  & 

g  fa  rfa 
O  to  O 
U  <  d3 


<D  .ti 

cS  C 

>,  w 

^  o 

03  IG 
5-h  JD 

2  3 
§  & 
6£>  "fa 

1,1 


S  3) 
173  c 
<d  .a 

b  b 
a  a 

O  C/5 

T-  c 
a 

o  _, 


r-  C.CJ 

E  o  fa 

Ego 

o  H  S 

Us  fa 


Comments: _ 

Efforts  should  be  made  to  aggressively  network  with  other  state’s  public  entity  stakeholders  to  gain  their 
political  capital  and  support  for  continued  public  entity  existence  after  a  public  private  competition. 
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Comments: 

A  public  entity  generally  has  no  concept  of  what  a  service  or  product  costs  them. 
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Avoiding  Common  Mistakes  of  Integrating  a  Cost  System 
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Comments: _ 

Is  there  anything  else  you  would  like  to  add  in  regards  to  using  Consultants? 
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Highlighting  unused  capital  capacity  is  a  competitive  strength  in  a  public  private  competition. 
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Is  there  anything  you  would  like  to  add  in  regards  to  advertising  a  reliable  infrastructure? 
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Lack  of  experience  and  knowledge  of  the  competitive  business  environment  is  a  problem  for  public 
teams  attempting  to  develop  competitive  proposals. 
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Appendix  B:  Survey  Two  and  Cover  Letter 

This  is  a  copy  of  the  second  survey  sent  out  to  the  Delphi  experts.  It  consists  of 
information  based  strictly  on  Survey  One  and  expert  feedback.  The  Cover  Letter  and 
Survey  Two  were  both  sent  to  each  expert  as  electronic  mail  attachments. 
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13  Nov  01 

Subject:  Public  Private  Competition  Survey 
Hello  All, 

Thank  you  very  much  for  your  prompt  response  to  the  first  round!  Your  inputs  have 
been  great  and  the  results  look  very  interesting.  Based  on  the  scores  provided  in  the  last 
round,  each  question  with  an  average  value  of  less  than  3.0  was  dropped.  This 
represented  a  total  loss  of  7  questions.  However,  after  researching  your  comments,  two 
questions  were  identified  as  being  confusing  in  their  presentation.  As  a  result,  1  rewrote 
these  two  to  better  represent  the  question;  these  are  reflected  in  the  numbering  sequence 
as  an  “R”  after  the  question  number. 

Of  the  remaining  5  questions,  9  additional  questions  were  formulated  from  the 
comments.  Those  of  you  who  included  new  information  will  hopefully  see  those  ideas 
represented  in  this  new  set.  Your  feedback  only  improves  the  study,  and  makes  it  that 
much  more  meaningful  to  the  customer  of  this  effort.  This  new  question  set  is  presented 
to  you  after  the  last  open-ended  question  for  each  pertinent  section.  They  are  identified  in 
the  following  manner:  ex.  7-1-N 

In  Survey  2,  you  will  also  see  that  the  average  score  for  the  group  and  your  previous 
score  for  each  question  have  been  included.  Please  consider  this  information  and  re¬ 
score  as  you  see  fit.  Once  again,  a  scale  between  1  and  5  is  used  to  describe  the  level  of 
agreement  with  each  statement.  Please  ensure  that  you  read  the  first  page  of  the  survey; 
this  gives  you  a  more  detailed  description  of  the  number  scale,  as  well  as,  some  key 
definitions  used  throughout  the  instrument  itself. 

Please  complete  the  survey  as  a  word  document  using  the  highlight  function  to  identify 
you  choice.  If  you  have  no  highlight  function,  then  please  bold  the  number.  You  will 
notice  there  are  areas  for  comments  after  each  question  and  after  each  section.  Again, 
please  feel  free  to  include  any  thoughts  that  would  further  the  understanding  of  the 
particular  statement,  subject,  or  introduce  a  new  factor  not  mentioned. 

Due  date:  20  Nov  01 

Then  just  simply  email  it  back  to  me  as  an  attachment.  Timothy.Gilbride@afit.edu 
If  you  have  any  questions,  feel  free  to  contact  me  at  (937)  236-0212  (h)  or  via  email. 

Sincerely, 

Timothy  J.  Gilbride,  LCDR,  USCG 

Graduate  Student,  Air  Force  Institute  of  Technology 
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For  each  question,  please  highlight  the  number  that  best  describes  your  level  of  agreement. 
Rate  between  1  and  5 


In  your  past  experiences  or  studies  are  there  any  other  points  in  Congressional  mobilization 
that  should  be  mentioned  or  addressed  to  be  included  in  this  study? 
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1 3-4-1  Local  funding  could  offset  these  costs. 


SECTION  2:  COST  FACTOR 
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Group  Your 
AVG  Previous 

For  a  public  entity  to  be  competitive  in  a  public  private  competition,  a  cost  system  is 
required  that  is  capable  of  capturing  these  true  total  costs  which  provide  upgraded 
15  3.875  information  for  decision-making 


In  addition  to  the  total  cost,  identifying  the  true  costs  associated  with  the  product  is 
necessary  to  ensure  the  source  selection  team  can  conduct  a  fair  evaluation  during  a  public 
16  4.75  private  competition. 
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The  ABC  cost  system  could  provide  the  information  necessary  for  public  management  teams 
to  make  quality  improvements  and  structure  business  practices  to  better  meet  the 
23  4.25  overarching  customer’s  needs. 
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Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 

The  next  subsection  regards  the  Transition  of  a  Cost  System  into  a  Competitive  Cost  Proposal. 
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Is  there  anything  you  would  like  to  add  in  regards  to  corporate  knowledge  and  expertise? 
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Is  there  anything  you  would  like  to  add  in  regards  to  performance  guarantees  for  the  public  entity? 


C  .ts 

0)  -4-* 

E  g 

o"  u 
—  a 
a>  5 
>  .c 

(U  s- 
"O  & 


o, 

_  cl 
•£  x 

f  « 


3  ° 
<£  2 


<L>  — 

jo  2 
■o  2 
"5  ^ 

O  60 
jG  G 


C3 

00 

o 

CJ 

O 

S— i 

1  § 

11 
cl  O- 
_7  G 
c3  2 
,5  G 

^  8- 

$  Q 

60  5. 

G  _| 
>  .2 


G  > 

•  •  C  — 
O  — ( 

G  ° 

<0  U  o 
g  3  G 
G  “ 

3  3  00 

u  o  1 


G  CL 

2  o 


O  ^ 
U  Oh 


Appendix  C:  Survey  Three  and  Cover  Letter 

This  is  a  copy  of  the  third  survey  sent  out  to  the  Delphi  experts.  It  consists  of 
information  based  strictly  on  Survey  Two  and  expert  feedback.  The  Cover  Letter  and 
Survey  Three  were  both  sent  to  each  expert  as  electronic  mail  attachments. 
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26  Nov  01 

Subject:  Public  Private  Competition  Survey 
Hello  All, 

Well,  we  are  finally  at  the  last  Survey,  number  3!  Thank  you  very  much  for  your 
prompt  response  to  the  Second  round!  Once  again,  your  inputs  have  been  great,  as  well 
as,  your  comments.  1  appreciate  each  of  you  taking  time  to  ensure  that  1  understand  why 
you  agree  or  disagree  with  a  statement.  This  is  extremely  important  because,  remember, 

1  am  using  your  inputs  to  strengthen  and  improve  the  causal  model. 

Speaking  of  the  causal  model,  it  appears  that  you  all ,  as  a  group,  have  preliminarily 
indicated  that  the  three  categories  (Organic,  Cost,  Politics)  are  satisfactory.  This  is  nice 
to  know  because  it  concurs  with  a  lot  of  literature  written  on  these  topic  areas.  Once 
again,  what  makes  this  study  interesting  is  the  level  of  “comment  data”  that  1  am 
receiving  from  you  referencing  issues  within  these  categories. 

*Round  2  Data  Examination  witnessed  no  loss  of  questions  due  to  low  score. 

*  There  were  no  new  questions  (topics)  added  to  the  Survey.. 

In  Survey  3,  you  will  also  see  the  average  score  for  the  group  and  your  previous 
score  (from  Survey  21  for  each  question  have  been  included.  Please  consider  this 
information  and  re-score  as  you  see  fit.  You  have  seen  ALL  the  questions  on  Survey  3 
previously. 

Once  again,  a  scale  between  1  and  5  is  used  to  describe  the  level  of  agreement  with 
each  statement.  Please  ensure  that  you  read  the  first  page  of  the  survey;  this  gives  you  a 
more  detailed  description  of  the  number  scale,  as  well  as,  some  key  definitions  used 
throughout  the  instrument  itself. 

Please  complete  the  survey  as  a  word  document  using  the  highlight  function  to  identify 
you  choice.  If  you  have  no  highlight  function,  then  please  bold  the  number.  You  will 
notice  there  are  areas  for  comments  after  each  question  and  after  each  section.  Again, 
please  feel  free  to  include  any  thoughts  that  would  further  the  understanding  of  the 
particular  statement,  subject,  or  introduce  a  new  factor  not  mentioned. 

Due  date:  4  Dec  01 

Then  just  simply  email  it  back  to  me  as  an  attachment.  Timothy.Gilbride@afit.edu 
If  you  have  any  questions,  feel  free  to  contact  me  at  (937)  236-0212  (h)  or  via  email. 

Sincerely, 

Timothy  J.  Gilbride,  LCDR,  USCG 

Graduate  Student,  Air  Force  Institute  of  Technology 
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For  each  question,  please  highlight  the  number  that  best  describes  your  level  of  agreement. 
Rate  between  1  and  5 
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4.29  Local  funding  could  offset  these  costs. 


SECTION  2:  COST  FACTOR 
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For  a  public  entity  to  be  competitive  in  a  public  private  competition,  a  cost  system  is 
required  that  is  capable  of  capturing  these  true  total  costs  which  provide  upgraded 
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In  addition  to  the  total  cost,  identifying  the  true  costs  associated  with  the  product  is 
necessary  to  ensure  the  source  selection  team  can  conduct  a  fair  evaluation  during  a  public 
private  competition. 
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The  ABC  cost  system  could  provide  the  information  necessary  for  public  management  teams 
to  make  quality  improvements  and  structure  business  practices  to  better  meet  the 
overarching  customer’s  needs. 
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Failure  to  allocate  overhead  is  a  common  mistake  that  leads  to  distorted  proposal  costs  used 
during  a  public  private  competition. 
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Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 

The  next  subsection  regards  the  Transition  of  a  Cost  System  into  a  Competitive  Cost  Proposal. 
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Is  there  anything  you  would  like  to  add  in  regards  to  corporate  knowledge  and  expertise? 
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Intentionally  left  blank 

Is  there  anything  you  would  like  to  add  in  regards  to  performance  guarantees  for  the  public  entity? 


Appendix  D:  Public  Private  Competitive  Assessment  Tool  (PCAT) 

This  is  a  copy  of  the  PCAT  instrument.  It  was  sent  to  each  AR&SC  management 
representative  as  electronic  mail  attachment.  There  are  representative  “zero”  numbers  in 
the  response  cells  to  display  that  this  was  an  active  Microsoft  Excel  Spreadsheet. 
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Gentlemen, 


Attached  you  will  find  an  Evaluation  of  AR&SC  in  regards  to  its  preparedness  for  a  public 
private  competition.  I  would  appreciate  you  taking  approximately  15  minutes  and  filling  out 
this  survey  then  sending  it  back  to  me  as  an  email  attachment. 

Definition:  A  public  private  competition  is  when  a  government  organization  and  a  private 
company  compete  for  traditionally  completed  government  workloads.  Example  would  be  Falcon 
Jet  Corp  and  AR&SC  competing  for  HU-25  depot  work. 

For  the  past  15  months,  I  have  been  assigned  to  the  Air  Force  Institute  of  Technology!  in 
Dayton,  Ohio  studying  Systems  Management  on  a  TAB  from  G-SEA.  As  part  of  this  curriculum, 
I  am  required  to  complete  a  Thesis  project.  During  the  past  year,  I  have  identified,  and  verified 
through  experts  in  the  field  of  public  private  competitions,  three  main  factors,  and  multiple  sub 
factors,  which  a  public  organization,  like  AR&SC,  must  pay  attention  in  order  to  field  a 
competitive  workload  proposal.  (Some  of  you  have  already  participated  in  the  first  part  of  this 
study.)  With  these  identified  factors,  I  have  come  up  with  an  assessment  tool  attached  via  this 
email. 

The  underlying  motivation  of  this  study  is  the  threat  to  AR&SC  from  the  Integrated 
Deepwater  System  (IDS)  program.  This  threat  consists  of  outsourcing  workloads  presently 
conducted  by  E-city,  with  the  worse  scenario  being  the  outsourcing  of  all  activities  of 

AR&SC . meaning  the  conceivable  shutdown  of  the  organization.  Although  this  complete 

closure  is  a  remote  possibility,  IDS  Acquisition  personnel  have  mentioned  that  AR&SC  owns  key 
workloads  targeted  by  the  IDS  Support  Cost  Reduction  efforts. 

The  focus  of  my  thesis  is  the  following:  AR&SC  does  an  excellent,  and  probably  cost 
effective,  job  in  their  core  competencies.  To  be  competitive  against  an  IDS  outsourcing  effort, 
AR&SC  would  need  to  allocate  resources  toward  certain  factors  that  have  historically  been  the 
foundations  of  competitive  Public  Private  proposals. 

This  Evaluation  tool  attached  is  the  last  part  of  the  study.  It  is  hoped  the  information  gained 
from  this  tool  can  provide  a  strategic  assessment  of  AR&SC  in  regards  to  its  ability  to  compete 
today  against  the  Lockheed  Martin  and  Boeings  of  the  private  industrial  world. 

LCDR  Jewess  has  been  my  point  of  contact  at  AR&SC  during  the  study.  If  you  have  any 
questions  please  contact  his  office  or  send  me  email  at 

Timothv.Gilbride@afit.edu. 

I  would  appreciate  your  inputs  by  COB  Monday, . January  14,  2001.  Again,  simply  fill  out 

the  survey  and  send  it  back  as  an  attachment  to  the  afit.edu  email  address. 

Thank  you, 

Tim  Gilbride 

LCDR  USCG 

Graduate  Student 

Air  Force  Institute  of  Technology 
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Mobilization  of  ELECTED  Officials 
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1.1.3  County  Political  Pressure 
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Utilization  of  Private  Interest  Groups 


1.2.3  Other  Interest  Groups 

AR&SC  Labor  Unions  have  been  contacted  to  be  a  partner  in  developing  a  competitive  proposal  for  Public 
Private  Competition 


State  and  Local  Legislators  have  been  contacted  to  be  a  partner  in  proposal  development.  (Example.  State 
andLocal_fundinCTcouldoffietcostofim£rovementsJn^uildin£sornewfecilities;]^^^^^^_^^^^^^_ 
AR&SC  Labor  Unions  have  agreed  to  be  a  partner  in  developing  a  competitive  proposal  for  Public  Private 

State  and  Local  Legislators  have  agreed  to  be  a  partner  in  proposal  development.  (Example.  State  and  Local 
funding  could  offset  cost  of  improvements  in  buildings  or  new  facilities.) _ 
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Applying  a  Managerial  Cost  System 
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Sub  Factor  2.2 

Integrating  a  Cost  System 

This  next  subsection  engages  the  factors  associated  with  developing  and  utilizing  a  Cost  System  in  the  organization. 
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2.2.2  Use  Consultants  to  help  Integrate  and  Use  a  Cost  System 

The  next  section  addresses  the  use  of  outside  assistance  in  the  preparation  of  a  competitive  public  cost 
proposal  for  a  public  private  competition.  The  purpose  of  consultants  would  be  to  integrate  their  knowledge 
of  business  reengineering ,  cost  systems,  and  competitive  proposal  development  with  the  AR&SC 
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Identification  of  Core  Competencies 
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AR&SC  management  has  a  system  in  place  which  captures  this  corporate  knowledge  from  the  experts. 
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Appendix  E:  PCAT  Flow  Chart 


This  is  a  copy  of  the  PCAT  Flow  Chart.  It  was  sent  to  each  AR&SC  management 
representative  as  electronic  mail  attachment.  It  is  a  key  part  of  the  PCAT  instrument. 
When  the  PCAT  file  is  opened,  this  is  the  first  figure  that  is  presented  to  the  user. 
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PUBLIC  PRIVATE  COMPETITION  ASSESSMENT  TOOL  (PCAT) 
for  AR&SC 
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Appendix  F:  Raw  Data  Survey  One 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  the  raw  data  collected 
from  Survey  One  responses. 
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Appendix  G:  Raw  Data  Survey  Two 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  the  raw  data  collected 
from  Survey  Two  responses. 
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Appendix  H:  Raw  Data  Survey  Three 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  the  raw  data  collected 
from  Survey  Three  responses. 
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Appendix  I:  Threshold  Evaluation  Data 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  the  Threshold 
Evaluation  Data  from  Survey  One  responses. 
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Round  One  Raw  Data  Breakout 
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Appendix  J:  Raw  Data  Standard  Deviation  Delta  Round  One  to  Round  Two 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  standard  deviation  delta 
computations  from  survey  round  one  to  survey  round  two. 
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STANDARD  DEVIATION  DELTA  BETWEEN  ROUND  ONE  AND  TWO 


SURVEY  1 

Mean 

Std  Dev 

4.4286 

0.7868 

0.0000 

0.0000 

4.5714 

0.7868 

3.5714 

1.3973 

3.0000 

1.6330 

1.4286 

0.7868 

0.0000 

0.0000 

4.5714 

0.5345 

2.7143 

1.8898 

1.8571 

1.2150 

3.1429 

1.3452 

3.2857 

1.4960 

0.0000 

0.0000 

4.7143 

0.4880 

4.0000 

1.2910 

4.7143 

0.4880 

4.7143 

0.4880 

4.2857 

0.9512 

4.1429 

0.8997 

2.8571 

1.7728 

2.4286 

1.6183 

3.8571 

1.0690 

4.1429 

0.6901 

3.4286 

0.7868 

0.0000 

0.0000 

3.7143 

1.7043 

3.4286 

1.7182 

3.7143 

1.6036 

4.7143 

0.4880 

4.1429 

0.6901 

0.0000 

0.0000 

3.4286 

1.5119 

4.2857 

0.7559 

4.2857 

1,1127 

4.0000 

1.4142 

2.2857 

1.6036 

0.0000 

0.0000 

4.8571 

0.3780 

4.8571 

0.3780 

4.8571 

0.3780 

4.8571 

0.3780 

4.7143 

0.4880 

0.0000 

0.0000 

3.5714 

0.7868 

0.0000 

0.0000 

4.2857 

0.4880 

4.0000 

1.5275 

3.1429 

1.5736 

4.7143 

0.4880 

4.2857 

0.9512 

3.4286 

1.7182 

4.2857 

0.9512 

|  SURVEY  2 

Mean 

Std  Dev 

4.428571 

0.7868 

4.428571 

0.7868 

3.857143 

0.6901 

3.571429 

1.2724 

0 

0.0000 

4.714286 

0.4880 

4 

0.8165 

3.428571 

1.3973 

0 

0.0000 

4.857143 

0.3780 

4.285714 

1.1127 

4.714286 

0.4880 

4.714286 

0.4880 

4.428571 

0.7868 

4.285714 

0.7559 

3.428571 

1.5119 

4.285714 

0.7559 

3.714286 

0.9512 

4.142857 

0.6901 

3.857143 

0.6901 

0 

0.0000 

3.714286 

1.7043 

3.428571 

1.7182 

3.714286 

1 .6036 

4.857143 

0.3780 

4.142857 

0.6901 

0 

0.0000 

3.571429 

1.1339 

4.285714 

0.7559 

4.285714 

1.1127 

4.142857 

1,0690 

3.857143 

1.0690 

0 

0.0000 

4.857143 

0.3780 

4.857143 

0.3780 

4,857143 

0.3780 

4.857143 

0.3780 

4.714286 

0.4880 

3.714286 

0.7559 

0 

0.0000 

4.285714 

0.4880 

4 

1.5275 

3.571429 

1.5119 

4.714286 

0.4880 

4.285714 

0.9512 

3.428571 

1.7182 

4.285714 

0.9512 

Round  1-2 


Std  Dev  Delta 


0.0000 


0.0000 


0.7072 


0.3606 


0.0000 


0.0466 


0.5287 


0.0988 


0.0000 


0.1100 


0.1783 


0.0000 


0.0000 


0.1644 


0.1438 


0.2610 


0.8624 


0.1179 


0.0000 


0.0967 


0.0000 


0.0000 


0.0000 


0.0000 


0.1100 


0.0000 


0.0000 


0.3780 


0.0000 


0.0000 


0.3452 


0.5345 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0.0309 


0.0000 


0.0000 


0.0000 


0.0617 


0.0000 


0.0000 


0.0000 


0.0000 
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STANDARD  DEVIATION  DELTA  BETWEEN  ROUND  ONE  AND  TWO 


53 

0.0000 

0.0000 

53 

0 

0.0000 

53 

0.0000 

54 

4.4286 

0.7868 

54 

4.571429 

0.5345 

54 

0.2523 

55 

3.7143 

0.9512 

55 

3.714286 

0.9512 

55 

0.0000 

56 

3.7143 

1.2536 

56 

3.714286 

1.2536 

56 

0.0000 

57 

3.8571 

1.0690 

57 

3.571429 

0.9759 

57 

0.0931 

58 

0.0000 

0.0000 

58 

0 

0.0000 

58 

0.0000 

59 

3.2857 

1.4960 

59 

3.285714 

1.2536 

59 

0.2425 

60 

3.2857 

1.7043 

60 

3.285714 

1.7043 

60 

0.0000 

61 

4.1429 

1.2150 

61 

4.285714 

1.1127 

61 

0.1023 

62 

0.0000 

0.0000 

62 

0 

0.0000 

62 

0.0000 

63 

3.1429 

1.4639 

63 

3.142857 

1.4639 

63 

0.0000 

64 

3.8571 

1.4639 

64 

3.857143 

1.4639 

64 

0.0000 

65 

0.0000 

0.0000 

65 

0 

0.0000 

65 

0.0000 

66 

3.5714 

1.3973 

66 

3.571429 

1.3973 

66 

0.0000 

67 

0.0000 

0.0000 

67 

0 

0.0000 

67 

0.0000 

68 

3.7143 

1.7043 

68 

3.571429 

1.6183 

68 

0.0860 

2.7143 

1.1127 

70 

0.0000 

0.0000 

70 

0 

0.0000 

70 

0.0000 

71 

4.8571 

0.3780 

71 

4.857143 

0.3780 

71 

0.0000 

72 

4.0000 

1.1547 

72 

4 

1.1547 

72 

0.0000 

73 

4.8571 

0.3780 

73 

4.857143 

0.3780 

73 

0.0000 

74 

0.0000 

0.0000 

74 

0 

0.0000 

74 

0.0000 

1 3-1  -N 

4.428571 

1.1339 

“13-1-8 

-1.1339 

13-2-N 

4.714286 

0.4880 

13-2-N 

-0.4880 

13-3-N 

4.714286 

0.4880 

13-3-N 

-0.4880 

13-4-N 

4.285714 

0.9512 

1.'.  -1  N 

-0.9512 

25-1 -N 

4.571429 

0.5345 

. 25-1  N 

-0.5345 

37-1 -N 

4.571429 

0.5345 

37  1  N 

-0.5345 

7-1-N 

4.714286 

0.4880 

7-1-N 

-0.4880 

7-2-N 

3.571429 

1.6183 

7-2-N 

-1.6183 

74-1 -N 

4.571429 

0.5345 

74-1 -N 

-0.5345 
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Appendix  K:  Expert  #2  Survey  Three 

This  is  a  copy  of  the  Expert  #3  Survey  Three.  It  is  presented  to  show  what  a  survey 
product  looks  like  after  customization  with  expert  feedback  from  previous  survey  inputs. 


216 


For  each  question,  please  highlight  the  number  that  best  describes  your  level  of  agreement. 
Rate  between  1  and  5 
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4.29  5  Local  funding  could  offset  these  costs. 


SECTION  2:  COST  FACTOR 
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For  a  public  entity  to  be  competitive  in  a  public  private  competition,  a  cost  system  is 
required  that  is  capable  of  capturing  these  true  total  costs  which  provide  upgraded 
15  4.29  5  information  for  decision-making 


In  addition  to  the  total  cost,  identifying  the  true  costs  associated  with  the  product  is 
necessary  to  ensure  the  source  selection  team  can  conduct  a  fair  evaluation  during  a  public 
private  competition. 
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The  ABC  cost  system  could  provide  the  information  necessary  for  public  management  teams 
to  make  quality  improvements  and  structure  business  practices  to  better  meet  the 
overarching  customer’s  needs. 
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Failure  to  allocate  overhead  is  a  common  mistake  that  leads  to  distorted  proposal  costs  used 
during  a  public  private  competition. 
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Transition  Cost  System  into  a  Competitive  Cost  Proposal  Structure 

The  next  subsection  regards  the  Transition  of  a  Cost  System  into  a  Competitive  Cost  Proposal. 

Group  Your 
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_ Comments: _ 

To  be  used  by  the  public  entity  successfully,  worthwhile  cost  comparability  guidance  would 
have  to  represent  the  same  procedures  that  the  RFP  was  developed  and  based  on  by  the 
52  4  29  5  overarchin8  agency.  (the  Source  Selection  Team  would  be  evaluating  the  RFP  responses 

based  on  the  same  cost  comparability  guidance.) 
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Highlighting  unused  capital  capacity  is  a  competitive  strength  in  a  public  private 
competition. 
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Intentionally  left  blank 

Is  there  anything  you  would  like  to  add  in  regards  to  performance  guarantees  for  the  public  entity? 
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Appendix  L:  Raw  Data  Standard  Deviation  Delta  Round  Two  to  Round  Three 

This  is  a  copy  of  the  Microsoft  Excel  Spreadsheet  containing  standard  deviation  delta 
computations  from  survey  round  two  to  survey  round  three. 


233 


STANDARD  DEVIATION  DELTA  BETWEEN  ROUND  TWO  AND  THREE  _ _ 

[SURVEY  2  [SURVEY  3  Round  2-3  Round  1-3  Dev  Delta 

_ Mean  Std  Dev _ Mean  Std  Dev _ Std  Dev  Delta _ Std  Dev  Delta _ 

_ 1  4.428571  0.7868  _ 1  4.428571  0.786796 _ 1_ _ 0.0000 _ -0.7868 

2  0  0.0000  2  0  0  2  0.0000  0.0000 
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Lieutenant  Commander  Timothy  J.  Gilbride  graduated  from  Jefferson  High  School  in 
Shenandoah  Junction,  West  Virginia  in  1986.  In  the  fall,  he  entered  Grove  City  College, 
Grove  City,  Pennsylvania  obtaining  a  Bachelor  of  Arts  degree  in  Economics  in  May 
1990.  Upon  graduation,  he  attended  the  U.S.  Coast  Guard  Officer  Candidate  School 
located  in  Yorktown,  Virginia;  he  was  commissioned  an  Ensign  in  September  1990. 

His  first  assignment  was  U.S.  Naval  Flight  Training  located  in  Pensacola,  Florida. 
Upon  receiving  his  wings  in  1992,  he  transitioned  into  the  Eurocopter  HH-65A  Dolphin 
helicopter  at  the  USCG  Aviation  Training  Center  in  Mobile,  Alabama.  His  first  aviation 
assignment  was  USCG  Air  Station  Detroit  where  he  served  as  a  Duty  Standing  Pilot, 
Assistant  Operations  Officer,  and  Supply  Department  Head. 

In  1996,  he  was  reassigned  to  USCG  Air  Station  New  Orleans,  Louisiana.  While  in 
New  Orleans,  he  again  served  as  a  Duty  Standing  Pilot  and  completed  training  as  an 
Aeronautical  Engineering  Officer.  In  early  1998,  he  was  reassigned  to  Air  Station  New 
Orleans  as  the  unit’s  Assistant  Engineering  Officer.  In  September  2000,  he  entered  the 
Graduate  School  of  Engineering  and  Management,  Air  Force  Institute  of  Technology. 
Upon  graduation,  he  will  be  assigned  to  U.S.  Coast  Guard  Headquarters  Office  of 
Aviation  Engineering. 
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